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Author’s Preface to Volumes I and II 


Random processes are of great and ever increasing interest to 
scientists and engineers working in various branches of radio physics. 
This is quite understandable, since at the present stage of technological 
development, random noise constitutes the chief obstacle to further 
improvement of certain engineering devices. In fact, a current problem 
in many fields of radio physics is that of evolving techniques for analy- 
sis and design of equipment which is immune to noise. Convincing 
proof of the importance and urgency of this subject is afforded by 
the large number of books devoted to it, published both in the U.S.S.R. 
and elsewhere. 

The present book, in two volumes, is concerned with a variety of 
topics which have been left to one side, as it were, but which are never- 
theless of great practical importance. In particular, we have in mind 
problems involving the effects of noise on electronic relays and vacuum- 
tube oscillators. Recently, there has been increased interest in the oper- 
ation of switching devices and self-excited systems, not only because of 
the development of methods of coherent radar detection, but also in 
connection with such problems as increasing the accuracy of time 
measurements, designing particle accelerators and computing ma- 
chines, etc. However, the journal literature in these new fields of 
statistical radio engineering is hard to penetrate. In the present book, 
noise in relays and oscillators is studied in an organized fashion, from 
a tather general point of view. Material that can be found in the 
literature has been systematized, and the results of some original 
investigations by the author have been included. The physical treatment 
of the results obtained may be a bit sketchy, but it seems to us that 
brevity coupled with wide coverage is justified in this instance, since 
the rapid growth in the total number of published papers has increased 
the need for some kind of survey, even one resembling a handbook. 
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From a mathematical point of view, the topics studied here involve 
nonlinear trausformations of random functions, mostly transfor- 
mations with memory. Certain mathematical methods are worked out 
in a form suitable for application to problems of radio engineering, 
and irc then exploited systematically. As the reader will discover, the 
following methods turn out to be effective: 


1. Reduction of a given process to a process without aftereffect, 
followed by application of Markov process techniques, in particu- 
lar, the Fokker-Planck equation; 


2. Linearization of the original equations, which allows us to apply 
correlation theory in the linear approximation; 


3. The quasi-static approach, which allows us to reduce a nonlinear 
transtormation with memory to one without memory. 


The treatnients in the available literature usually deal only with 
the correlation theory, or only with the theory of Markov processes. 
However, to solve concrete problems, one must be able to go from 
the methods of either theory to those of the other, choosing the best 
methods for solving the problem at hand. For this reason, we pay 
special alteution to the problem of when, and in what sense, the theory 
of Markoy processes can be applied to actual fluctuations, which are 
originally described in terms of the correlation theory. 

Part |] of Volume I is devoted to a review of the mathematical results 
used later in the book. In many places, it has seemed appropriate, for 
the sake of brevity, to depart from the usual presentation of the basic 
concepts and results of probability theory. The reader who is not 
familiar with this necessary background material can refer to any one 
of a number of textbooks. Those already acquainted with elementary 
probability theory will find that Part | contains a different treatment 
of certain well-known topics, in addition to some new results. In fact, 
Part | onght not to be devoid of interest even to mathematicians, 
provided, of course, that they make due allowances for the heuristic 
level of rigor adopted. 

In Voltme I, Part 2 and in Volume II, we systematically use the 
methods just enumerated to solve specific problems of statistical radio 
engineering. At the same time, we try to explain the conditions under 


which the various methods of analyzing noise phenomena are appli- 
cable. Perhaps some of the methods are given in more detail than is 
necessary for immediate applications, but this is done with a view ro 
further development of the tools needed for future work. It is reason- 
able to expect that the progressively more complicated problems which 
come up in engineering practice wil! require the use of progressively 
more sophisticated methods of analysis. The author will regard his 
task as accomplished if this book serves in some measure to broaden 
the theoretica! outlook of radio scientists, by helping them master 
certain methods which they may find novel ar first. Although the 
material given here is intended primarily for specialists in the field of 
statistical radio engineering, it should also interest scientists working 
in other fields where similar statistical methods can be profitably used. 

As a rule, no attempr is made to cite the papers where various 
results appear for the first time. This is because any attempt to make 
systematic source references would be likely to entail errors, unless one 
wishes to become involved in special bibliographic research. 

Finally, the author would like to take this opportunity to thank 
V. I. Tikhonov, who suggested that the present book be written and 
rendered substantial assistance, Y. L. Klimontovich, who in his capaci- 
ty as editor made many valuable suggestions while the manuscript was 
being prepared for the printer, and I. G. Akopyan, who constructed 
the figures appearing in Volume II, Chapter 9. The author would also 
like ro thank S. P. Strelkov, S. D. Gvozdover, B. R. Levin and §S. A. 
Akhmanoy for their helpful advice, as well as Y. M. Romanovski, 
P. S. Landa and V. N. Ivanov for their assistance with the manuscript. 
He also expresses his gratitude to Dr. R. A. Silverman for undertaking 
ro translate and edit the English-language edition of this book, thereby 
greatly enlarging its prospective audience, 


R.{G;S: 


Translator’s Preface to Volume I! 


As in the first volume, I have worked through all the mathematical 
derivations in detail. However, since the subject matter of the second 
volume {noise in relays and oscillators) is more difficult than that of 
the first, a stronger interaction with the author was neccssary, taking 
the form of an extended correspondence. During this period of almost 
a year, Dr. Stratonovich has examined the translation in manuscript, 
batch by batch, sparing no pains to answer all my queries, however 
persistent, with great wit and wisdom. This interplay has led to better- 
ments of all kinds, in particular the supplements to Chapters 2, 4, 5 
and 9. Moreover, it has had the pleasant side effect of establishing a 
friendship which I hope the future will afford occaston to renew. 


R. A. S. 
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PART 1 


Peaks of Random Functions and 
the Effect of Noise on Relays 


CHAPTER 1 


The Mean Number of Peaks 
of a Random Function 


In practice, one encounters a great variety of nonlinear trans- 
formations of random functions. Typically, a nonlinear device acts 
upon an input signal consisting of a useful signal contaminated by 
noise. Some transformations are only slightly nonlinear, while others 
are charactenstically nonlinear. Among the latter we cite systems (e.g. 
various kinds of relays with discontinuous transfer characteristics) 
whose response undergoes a jump discontinuity depending on the 
size of the input signal, It is difficult to give a general theoretical 
analysis of nonlinear systems. However, separate categories of non- 
linear systems can be studied by special methods, applicable tn re- 
stricted regions. 

This and the following two chapters are devoted to the study of 
some methods suitable for analysing nonlinear devices of the relay 
type, which respond when the input signal x(1) exceeds a certain fixed 
level b. If at the time ¢ the variable x(r) “‘up-crosses” the level 4, i.e., 
reaches and immediately thereafter exceeds 6, then the function x(t) 
is said to have a ‘“‘peak”’ at time ¢. Sometimes relay-type systems are 
used to count peaks. For example, it might be required to determine 
the number of input pulses in a system where each pulse produces its 
own peak, The presence of noise in the input signal, along with the 
useful pulses, can lead to a “false peak,” i.e., a peak entirely due to the 
noise rather than to the useful signal, which however causes the relay 
to operate. (This might be called ‘‘false operation” of the relay.) Thus 
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the presence of noise introduces an error in the number of counted 
peaks, and a theoretical problem posed by practical considerations 
is to determine the size of this etror. 

The theoretical problem is often complicated by the fact that a relay 
cannot usually respond to each peak, thereby counting the exact 
number of peaks. In fact, if the peaks follow one another too closely, 
some of them will be lost because of the device’s insufficient resolving 
power. Even a single peak can be lost if it is too short or too weak. 
Thus, instead of just calculating the exact number of peaks, the 
theory should give a more detailed description of the properties of the 
peaks such as the distribution of duration and power of the peaks. 

From the above remarks it is evident that the theory of operation of 
nonlinear systems of the relay type intimately involves the study of 
peaks of random functions and their properties. The results so ob- 
tained turn out to be useful in many other contexts (e.g., problems 
involving durability and fatigue of materials). 


1. The Mean Number of Peaks of a Smoothly Varying Process 


Suppose we are given a random process x(t) such that x(r) is close 
to the line segment x(t’) =x(t)+ X(1)(t’ —1) during a sufficiently small 
time interval r<r’<1t+ dt. (The significance of this smoothness con- 
dition will soon be apparent.) Then the points at which x(t) crosses the 
level x= cannot lie too close together, and in fact no more than one 
such point of intersection can occur in the indicated interval. To 
calculate the mean number of peaks which begin in the interval from 
fto t+ At, let P, denote the probability that one such peak occurs and 
let Py denote the probability that no such peak occurs. Obviously, 
there are no other possibilities, and the mean number of peaks be- 
ginning in the interval is just P,. It will be assumed that we know the 
joint two-dimensional probability density w(x, x) of x(t) and its de- 
rivative x(t). Then the expression 


dP = w({x,x)A4xAx (1.1) 


is the probability that the approximately linear curve x(t) intersects 
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Me t»At t 


Fig. 1. Beginning of a peak during the interval [7,7 -+ Jf]. 


the vertical segment AB of length 4x shown in Figure 1, while at the 
same time its dertvative lies between x(t) and x{t)+ Ax. 

Now consider the probability of an intersection not with the vertical 
segment AB but with the horizontal segment AC of length Ar. If the 
derivative x(t) is fixed, then crossing a horizontal segment of length 
At is equivalent to crossing a vertical segment of length 4x=x4t. 
Therefore the probability of crossing the segment AC (wliich corre- 
sponds to the values t<¢’<f+At, x=b) and having a derivative 
between x and x+ Ax equals 


dP =w(x,x)xAtAx (x = b). (1.2) 
It follows on the one hand that the total probability of crossing AB is 
P, = At { w(b,8)3 ig: (1.3) 


Q 


and on the other hand that the probability density of the derivative x 
at the moment of inception of a peak is 


b, 
ad CDEZB: for x>0O, 


w(t) = rs X)X dx (1.4) 


for x<O. 
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As already indicated, the probability ({.3) is just the mean number 
of peaks which begin in the interval [t, t+ At]. Dividing P, by At, we 
find that the mean density of peaks, i.e., the density of their initial 
times, is given by 

no{?) = [ w(b.9)3 dx. (1.5) 


0 


For a stationary process x(f), the density (1.5) is independent of t, and 
is just the mean number of peaks occurring per unit time. To obtain the 
total number of peaks in the interval [fp, t,] for the case of a non- 
stationary process, we have to evaluate the integral 


ist 


| n{t) dt. 

to 
In what follows, we shall be concerned mainly with stationary pro- 
cesses. 

Example. Suppose x(t)is a stationary Gaussian process with mean 
value zero and correlation function (xx,)=07R({t). Because of the 
evenness of R(t), there is no correlation between x(t) and its deriva- 
tive X(t) at the same time, i.e., 


d 
(xX) = it (xXx,) 23 =0. (1.6) 


For a Gaussian process, lack of correlation between x and x implies 
that x and x are statistically independent. Therefore w(x, x) factors 
into a product of one-dimensional probability densities, so that for- 
mulas (1.4) and (1.5) become 
w(x) = 3 hee ae 
<I!) 
[oes dx 


0 


w()x (%>0), (1,7) 


and 


b 
No = ~ <|x1>. 
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Using the expression (1.3.6) for a Gaussian probability density,! and 
bearing in mind that 


(x)= 0, 0(%)= JSR, 


where 
d’R (t) 
Bas dz? : 
r=0 
we find that 
: x —42/2e2R, , 
WA{x)= >— e >O 1.8 
= aR («> 0) (1.8 
and 
R ~p2 2 
fe Le aaa (1.9) 


Thus we see that the derivative x at the time of inception of a peak has 
a Rayleigh distribution. 

The smoothness condition imposed on the function x(f) at the be- 
ginning of this section was used when we assumed that .x(f) is differ- 
entiable and close to a line segment during a sufficiently small time 
interval. In the present case, this is tantamount to the assuinption 
that <xx,> has a finite second derivative at 7=90. 


2. The Mean Number of Peak Clusters ofa Markov Process 


In all cases actually encountered in radio engineering practice, the 
process x(t) certainly satisfies the smoothness conditron discussed in 
the preceding section. In fact, the inductances and capacitances always 
present in the circuitry (whether wanted or not) act to smooth electrical 


1 The book by R. L. Stratonovich, Topics in the Theory of Random Noise, Volume f, 
revised English edition, translated by R. A. Silverman, Gordon and Breach Science 
Publishers, New York (1963), will henceforth be referred to simply as Volume J, 
and equation numbers in this reference will be preceded by the Ronian numeral 1. 
Thus (1.3.6) means equation (3.6) of Volume [, and so on. Similarly, Chapter 14 
means Chapter 4 of Volume I, p. [.8! means page 8! of Volume I, and so on. 
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signals, if only with a small time constant t,,. Correspondingly, the 
spectral density of the signal falls off rapidly at frequencies exceeding 
an upper cutoff frequency w,~ 1/t, (see Chap. 1.4, Secs. 2 and 12). In 
situations where the smoothing time t,,, is sufficiently small (i.e., 
smaller than the other important time constants), instead of explicitly 
introducing the smoothing time t,,,, we shall find it convenient to 
replace the actual process by a ‘“‘neighboring’’ unsmoothed process, 
like the processes without aftereffect or Markov processes, studied in 
Vol. I. 

Markov processes are a convenient abstraction and are in many 
respects simpler than smoothed (analytic) processes. However, the 
considerations given in the preceding section do not apply to Markov 
processes, since they are everywhere nondjfferentiable, as noted in 
Chap. 1.4. In fact, if x(r) is Markovian, the derivative dx(r)/dr has 
infinite variance and continually changes sign, chaotically oscillating 
up and down with “‘infinite frequency” (cf. p.1.81). Therefore, if x(t) 
intersects the level b at time ¢, there are an infinite number of other 
intersections at closely neighboring times, which means that the mean 
number of peaks js infinite. 

To illustrate this point, consider an exponentially correlated process 
x(t) which has been subjected to the smoothing operation ([.4.280) 
with time constant t,,,. According to (1.4.284), the smoothed process 
y(t) has the correlation coefficient 

eo 
Ry) =P (30). 


Applying formula (1.9), we find that the mean number of peaks of the 
smoothed process is 


JR? ~b2 {207 (y) 
Ng => @ , 
2n 

where 


2 
= oO, R= RO)= =. 


This shows that as the smoothing time approaches Zero, the number of 
peaks increases without limit. 
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Despite the fact that an exact Markov process has infinitely many 
points of intersection with a giveu level x=4, from Ume to time linite 
nonzero intervals of any preassigned duration do :ppear between 
these points of intersection. (This will be confirmed by the consider- 
ations of Chap. 2.) It follows that the points af intersection can be 
grouped into “‘clusters,’’ each of which contains infinitely many such 
pojnts but is of finite duration. In other words, because of its “jagged- 
ness,” the trajectory of a Markov process cannot intersect a given 
level just once, but rather all of a sudden produces a cluster of in- 
finitely many intersections. If the process is smoothed, the number of 
intersections in each cluster becomes finite and decreases as r,,, gets 
larger. Although the number of intersections in eacli cluster is strongly 
dependent on the smoothing time, the number of clusters and their 
arrangement is not, and a cluster will survive the smoothing operation 
if just one peak in the cluster is of duration greater tlian r,,,. (In Chap. 
2, Sec. 5, we shall examine in detail the relation between the peaks of a 
Markov process and those of processes obtained from it by smooth- 
ing.) Since the peaks in each cluster follow one another too closely to 
be distinguished by a counting device, it is often of interest to calculate 
the rate of arrival of “peak clusters” rather than the total number of 
peaks. We now devote our attention to this problem. 

It is meaningful to group a sequence of peaks into clusters only if 
the clusters are very “‘clumpy,” ie., if the mean time interval 7; 
between clusters is much greater than the duration 7. of the clusters 
themselves: 

T,> Ts. (1.10) 


This will be the case if the threshold x=5 lies in a region seldom 

reached by the coordinate x{t), which means that the probability 

W,,(b) is relatively small.2 Since we have the estimate 
1 

a{x) 


in the region where w,,(2x) is large, this condition, which in a certain 


(1.11) 


Wa (X) ~ 


2 For the meaning of tse(x), see p. 1.66. 
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sense is equivalent to the inequality (1.10), can be written as 


1 
Ws, (b) < a). (1,12) 
A more accurate condition for the applicability of the present con- 
siderations will be given later. 
Now suppose we are trying to determine the mean number of peak 
clusters of a Markov process x(t) which can be described by the 
fluctuation equation 


x=f(x)+é¢, (1.13) 


where €{r) is a delta-correlated random process, with méan zero and 
correlation function 


(ob) = KO(z). (1.14) 


For an actual process €(r), which is not completely delta-correlated 
and has a correlation time of order t,,,, the intensity coefficient K is 
given by the integral 


K= f (oe,) dt. 


The function f(x) in equation (1.13) can be related to a “potential 
function” U(x) by writing 
dU (x) 
sd dx — 
We assume that U(x) becomes infinite as |x|—+00, which means that 
there is a ‘‘restoring force’’ preventing the coordinate x(¢) from pene- 
trating the regron of infinitely large positive or negative values. 
Instead of (1.13), we might consider the more general fluctuation 
equation 


= Si (x1) + 81 00)e, (1.15) 


describing a one-dimensional process without aftereffect. However, 


the change of variable 
| dx, 
x= 
81 (x1) 


SEC. 2} THE MEAN NUMBER OF PEAKS 11 


carries (1.15) into the form (1.13), so that the process .v, (r) reaches the 
level b, if and only if the process x(t) reaches the level 


: a pren 


Therefore, in our calculations we can go over from (1.15) to the simpler 
equation (1.13). 

According to the results of Chap. 1.4, equation (1.13) is equivalent 
to the Fokker-Planck equation 


_ 6 dU _ Kew rig 
=--(/—w]+—-—. . 
ax \ax 2 dx? Sa 


Using (1.16), we can immediately find the stationary distribution 
W,,{x), Satisfying the condition w,(x)=0. In fact, it follows from 
(1.4.49) that 


xpoby 


-1 2 
w,,(x) = N° exp }- - Uo, 


w= few{-% veh dx. 


To calculate the mean repetition frequency of peak clusters, we try 
to find the reciprocal of this quantity, i.e., the mean time interval 
between first crossings of the given level by neighboring clusters. 
Suppose that at the time =f, (or, for simplicity, at =0), we ubserve 
that the level x=b is first crossed by one of the clusters. ‘The con- 
ditional distribution of x(t) at subsequent times 1>0 spreads out from 
a delta function 


w[x()|x(0) = 6] = d[¢()— 6] for *=0 (1.18) 


(1.17) 


to the stationary distribution 
w[x(t)|x(0) = 6] =w,,(x) for ¢> T,. (1.19) 


Here the time constant 7,, characterizes the duration of the transient 
process, i.e., the rapidity with which the stationary distribution is 
established. Any crossings of the threshold x=/ during this time will 
be grouped into a single cluster, and hence 


TS Ty, 
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since, after the stationary distribution is established, the coordinate 
x(t) will spend quite a long time in the region x— (x) ~a(x), where 
most of the probability (1.17) is concentrated. Only after a large mean 
time interval 7;,, called the mean first-passage time, will x(t) again 
arive at the level b, thereby creating a new cluster of intersections. 
Therefore, our previous condition (1.10) is essentially equivalent to the 
condition 

Typ> Ty: (1.20) 


These considerations imply that the mean interval between first 
crossings by consecutive clusters is approximately equal to the mean 
interval between the establishment of a Stationary distribution and 
the time when the boundary x= b is first reached. As shown in Chap. 
I.4, Sec. 6, such first-passage time problems are handled by solving 
the Fokker-Planck equation subject to the zero boundary condition 


w(b, t) = 0. (1.21) 


In so doing, we note that the normalization condition 
| w(x,0)dx = 1 


is satisfied only at the initial time r=0, when w(x, ¢) coincides with the 
initial distribution 
w(x,0) = w,,(x), (1.22) 
which is stationary in the present case. At subsequent times, the 
quantity 
b 
W(t)= | w(x, tdx (1.23) 


-@ 


is less than unity, and is just the probability that the curve x(f) fails 
to reach the value x= 5 during the time interval [0, r]. In other words, 
W(t) describes that fraction of the realizations of the process x(r) 
which have not yet managed to reach the boundary x=b. As time 
goes on, W(t) decreases due to the fact that more and more reali- 
zations are excluded from consideration as a result of having reached 
the boundary (cf. p. 1.80), The probability that first contact with the 
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boundary is made during the interval [#, ¢-++ dt] equals 
b 
dP=—dW=—Wdt=— ar | W(x, dx. (1.24) 


-—@¢ 


Using (1.16), we find at once that 


dP = [G(b, t) — G(-—,/)] dt, (1.25) 
where 
G t au K Ow | 26) 
’ Se eS vere 7 
e ) Ox 2 Ox ( 


is the probability current across the abscissa + (cf. p.1.42). Dropping 
the current G{— oo, /) at infinity, because of the impossibility of the 
coordinate taking infinite values, we easily see that 


W(t) = — G(b,?), (1.27) 


ie., the rate of decrease of probability equals the probability current 
G(b, t) through the boundary x=b. 

The probability (1.24) is the probability that first passage occurs 
between f and ¢-+d?, and hence the quantity — W is just the probability 
density of the first-passage time. The mean first-passage time is found 
by averaging and integrating by parts: 


Typ =~ [Wede= | U1 dt, (1.28) 
it] oO 


According to (1.4.113) and (14.111), the quantity (1.28), involving the 
solution of the differential equation (1.16), subject to the conditions 
(1.21) and (1.22), can be obtained in exact form in terins of quadra- 
tures. However, here it is pointless to find a complicated exact ex- 
pression for 7;,, since the very statement af the problein is already 
associated with approximations based on the condition (1.10) or (1.20). 
Therefore, we shall now find a simpler approximate solution of the 
problem, valid under these conditions. 

Applying the method presented in Chap. 1.4, Sec. 4, we look for a 
solution of equation (1.16), subject to the boundary condition (1.21) 
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and initial condition (1.22), in the form of an expansion 
[- 3) 
w(x,}= ¥ 7, e 7X, (x). (1.29) 
m=0 


Here the values of 7,, are determined from (1.22), while, according to 
(1.4.50), the eigenfunction X,,(x) satisfies the equation 


Ka’x, 4@ (aU 
he A A (1.30) 
2 dx Gx \dx | 
subject to the boundary conditions 
Xn(b)=0, G[X,J.--0 =9. (1.31) 


The boundary condition (1.21) differs from the boundary condition 
w,,(00, t)=0 or G[1,,],- 2 =0 satisfied by w,,. However, according to 
(1.12), this difference is not large. [f 6 approaches infinity, where 
W,, =O, the difference between the two boundary conditions disappears, 
and the functions satisfying (1.30) and (1.31) go into the corresponding 
functions X,,, defined for all values of x, which were considered in 
Chap [.4, Sec. 4. In particular, according to (1.4.53), Xq goes into 
w,,, and A, vanishes. It follows that for sufficiently large 5, satisfying 
the condition (1.12), Xq differs only slightly from w,, in the region of 
large probability, and A, differs only slightly from 0 (A) <A, 49,...). 
After a time ¢ much greater than the time 7,, required for the transients 
to die out and the stationary distribution to become established, i.e., 
for t> 7,,~1/A,, the only important term in the expansion (1.29) is 


w(x, t) = ToXq(x) e-7". (1.32) 


Moreover, because of the initial condition (1.22) and the closeness of 
Xq(x) to w,,(x) noted above, we have J, ~'1. 

Thus, for t>T7,,, a “quasi-static” regime is established, character- 
ized by an exponential decay of the probability density. However, the 
shape of the probability density remains unchanged, and is described 
by the function X (x) satisfying the equation 


Ka*X, 4a au 
2 dx* ax 


=- x, =~— A,X. (1.33) 
Ox 
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The total probability (1.23) equals 


Wr)=e™, 
since 
b b 
[ %o dx x | wy, dx ~ 1, 
-n ~@ 


and hence falls off slowly to zero. Formula (1.28) then gives 


1 
a a 


Integrating (1.33) from — 90 to x, we obtain 


K eX, __ aU 
KW af xyeyer 
5 ae ae 8 a(e)es 


A second integration gives 


b 


Kota) = 22 | exp] — 2 (U6) ~ UI} eG) 


z 


where 
g(x) = Xo(x')dx' = | Wy (x')dx’. 


(1.36) 


(1.37) 


(1.38) 


(1.39) 


Using the stationary distribution (1.17), we can write (1.38) in the form 


g(x’) 


ry wt [Sa 


(1.40) 


It follows from the inequality (1.12) that the integrand g/w,, is large in 
the region near b and small in the region of large probability «=x,, 


where 


Ww a 
st (Xy a(x) 
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In addition, we assume that 


dx' dx" j 
| > | ~ 07 (x). (1.41) 


Wy 


xy xy-o (x) 


5 

| &. dx’ 
Wse 

x1 


is weakly dependent on x,, provided that x, lies in the region of large 
probability. Moreover, the expression g/w,, is close to I/w,, in the 
region where it is large, since there 


Then the :ntegral 


b 


g (x) = | wy, dx’ wl, (1.42) 
as can be seen from (1.39). 
Thus, choosing x =x, in the region of large probability, and bearing 
in mind that in this region X,~w,,, we find from (1.40), after re- 
placing g by I, that 


ee: dx’ 

— = n? (1.43) 

Ao K J Wa(x’) 

or, more explicitly, 
b 

2 = : U d. 1.44 
T=H25 —, U(x , ; 
TAK | PK Ue ax (1.44) 


This is the desired expression for the mean repetition rate of peak 

clusters. Because of (1.41), the expression (1.44) is practically in- 

dependent of x,. According to (1.43), the basic condition (1.41) for 

applicability of our theory can be written in the form 
207(: 

Ege), 


a UK 


In view of (1.36), it is easy to see that this inequality is equivalent to 


(1.45) 
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the condition (1.20), since 


(cf. pp.1.22, 1.132). 


3. Application of the Formula for the Mean Repetition Rate 
of Peak Clusters 


We now give some examples illustrating the application of formula 
(1.44). 
Example 1. Consider the nonlinear restoring force 
x 
f(x) =— fo [x|’ (1.46) 


|x 


corresponding to the potential function 
U(x) =folx]. (1.47) 


According to (1.17), in this case we have 


(x) =< Zfolil}s N= F. (xy=0, a()= 
w(x) = — exp ¢— — folxl>, = , (x>=90, e(x)= : 
st N Pp K 0 x » x) 2fo 
(1.48) 
Applying (1.44), we find that 
1 N 
7 = jf, (e7Fr'e _ erent) ; (1.49) 
0 0 


The condition for the validity of the last result, which can be written 
in any of the three forms (1.10), (1.20) or (1.45), then becomes 


K €2f,b, 


and actually implies that (1.49) is weakly dependent on x, if b—x,> 
a(x). Neglecting the term e7/*'/*, we obtain the following expression 
for the mean repetition rate of the peak clusters: 

oe 


2 
Ag = r exp {- zi}. (1.50) 
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Example 2. Next consider the case of a linear restoring force: 
Ba 
f(x)=-— Bx, U(x)= 5% ; (1.51) 


In this case, the stationary distribution is Gaussian, i.e., 


wy(x) me, n= oe) |X, (1.52) 


and (1.44) gives 


8 
Sts JZ fem dx, (1.53) 
qo OK 
0 


where for x, we choose the mean value ¢x)=0. The condition for 
applicability of our theory is now the inequality fb?/K>1, which 
allows us to use the asymptotic series 


5 
K K 
x7K Pa cine pb2sK ae se |. 5 
[e¢ dx apo ° (ae ) (1.54) 
0 


Retaining only the first term of this expansion, we find the following 
expression for the mean repetition rate of the peak clusters: 


Ag = Bb ane ee te (1.55) 


It should be noted that the key factors in formulas (1.50) and (1.55), 
i.e., the exponentials 


exp | ~ Zs} and op", 


are nothing other than 


exp - = Uh. 


Such a factor is always obtained in cases where the expression 


exp {F uo} 
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can be replaced by the fiest two terms of its Taylor serics: 


exp {e U(b) - =F (b\Ce ~- oy. 


After making this substitution and replacing the lower limit of inte- 
gration by — oo, we find that 


2 
ig Dew | 3 Ue). (1.56) 


The fact that (1.50) and ({.55) are special cases of (1.56) is apparent at 
once. However, (1.56) does not cover many cases where the derivative 
dU(b) | 


ag EO) 


is insufficiently large, or cases where the derivative is even negative. 
Then an important role is played by the nonlinear term 
1 d?U (b) 
2. dx? 


(x — by’. 


(One such case will be considered in Chap. 9, Sec. 3). Cases can also 
arise where a Taylor series expansion of the function U(x) is altogether 
inapplicable. 

Example 3. Suppose the “force” and “potential” have the form 


K K 
Bo) Nala Lae U(x) = Fx? - . 


Inx. (1.57) 
Then x(t) is a Rayleigh process (see pp. 1.73, [.192-1.195), with the 
stationary distribution 
X -xh202 2 K 

Wye (X) = aa é is ¢ = *) . (1 58) 
Unlike the preceding examples, x(t) can now take positive values only, 
and moreover small values x<o are just aS unlikely as large values 
x>o. Thus, the condition for applicability of our theory will be satis- 
fied if we choose a very low level b <a. This allows us to calculate the 
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number of clusters of intersection points, provided suitable slight 
modifications are made in the formulas derived above, corresponding 
to the fact that the region of probable values of the coordinate lies 
above (rather than below) the threshold level. Using formula (1.43) 
and choosing x, =a, we find that 


1 1 dx 
an 1.59 
ho al x : ) 
5 


Here the main contribution to the integral is made by the region near b, 
where e* /2°" = J. Replacing the exponential by unity, we obtain 


A 


do = mary, (1.60) 
and the condition (1.45) for applicability of the theory becomes 
in ke (1.61) 
B 


In conclusion, we say a few words about the condition (1.10) under- 
lying the above considerations. The condition is satisfied when the 
threshold 6 is relatively high, or when the “scatter” of the noise 
fluctuations is small. This is the case of greatest practical interest, 
since the noise level in a device intended for a given application, such 
as counting pulses, must not be so high as to prevent the basic oper- 
ation of the device. In fact, the perturbation due to the noise must be 
relatively small, for otherwise the excessive number of false peaks 
would render normal operation of the device impossible and make it 
unsuitable for practical purposes. Therefore, we can assume that the 
“small-fluctuation condition” (1.10) is satished in most engineering 
situations. 


CHAPTER 2 


The Duration of Peaks 
of a Markov Process 


In many problems, it is not enough to know the mean number of 
peaks, since the system under consideration can often respond only 
to peaks satisfying certain conditions. One such condition involves the 
duration of the peaks. Suppose there is a certain minimum peak du- 
ration t such that peaks of smaller duration “go unnoticed.’* Then, 
obviously, the quantity of interest is not the average total number of 
peaks “4g (per unit time) but rather the average number of peaks n{r) 
whose duration exceeds f. 

Suppose the total number of peaks is finite and known, and suppose 
we have managed to find w(t), the probability density of the distri- 
bution of peaks with respect to duration. Then #(r) is given by the 
formula a 


n(t) = Ng | w(t)dr [ng = n(0)]. (2.1) 


t 


In the case of Markov processes, the total number of peaks is infinite, 
because of the arbitrarily large number of arbitrarily short peaks, and 
hence a normalized probability density w(t) does not exist. Never- 
theless, n{t) is a well-defined and finite quantity, which we shall calcu- 
late in this chapter. 

As will be shown in Sec. 5, an actual smoothlily varying random 
Process, which can be obtained by subjecting a neighboring Markov 
Process to smoothing with a small time constant 1,,,. has almost the 


2! 
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same number of peaks of duration t > T,,, as the Markov process itself. 
Therefore, the results to be presented here apply not only to Markov 
processes but also to the “‘nearly-Markovian” smoothly varying pro- 
cesses encountered in practice. 


1. The Mean Number of Peaks of Duration Exceeding < 


We again consider a Markov process satisfying the fluctuation 
equation! 


X=f(xy te, (2.2) 


where €(r) is a delta-correlated random process, with mean zero and 
correlation function 


(of. = KO(z). (2.3) 
Corresponding to (2.2), we have the Fokker-Planck equation 
v4 


ar: Ka 
erg wl aa 


’ 
x? 


(2.4) 


which describes the way the probability density w(x, f) evolves in time. 


fo fo+T t 


Fig. 2, Beginning and end of a peak. 


1 Recall that a change of variable converts the Auctuation equation (1.15) to this 
form, so that (2.3) is actually quite general. 
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Our problem is to calculate the quantity u(r), the mean density of 
peaks whose durations exceed a given posilive number t. Consider a 
small interval [to, f9 + 4t|, where 4¢<c, and let 4n be the mean num- 
ber of peaks which begin in this interval and end at a line f>fg+t 
(see Figure 2). For simplicity, we henceforth set tg=0. Once we have 
calculated An, the required mean density of peaks can be found by 
taking the limit 


(t) = li an (2.5) 
Ait) = lim —. i 
a0 At 


For every realization of the process, there can be no more than one 
peak of the type described, and in fact, An is just the probability of 
occurrence A P of such a peak. It should be noted that if a peak begins 
in the interval [0, 4¢] and ends at a time ¢>c, then the trajectory 
crosses the level x= at least once during the interval [0, 4/], and 
exceeds this level during the interval [ 4/, c], 1.e., 


x({t)>b for At<r<t. (2.6) 


We now divide the trajectories of the process x(f) into two classes, 
the first consisting of all trajectories which cross the level / during the 
interval [0, Af], and the second consisting of all other trajectories. 
Suppose the trajectories of both kinds are described by 4 probability 
density wo(x)= w(x, 0), satisfying equation (2.4.) In particular, if the 
process x(f) is stationary, then wo(x) is the stationary distribution 
(1.17). The probability density w, (x, 1), describing the trajectories of 
the first class, which never cross the level b, must satisfy the same 
equation (2.4) with the following obvious initial and boundary con- 
ditions: 

w, (x, 0) = w(x,0)  (x> bd), 
(2.7) 

w, (5,1) =0 (O<t<Ar). 
The trajectories of the second class, which are left alter eliminating 
trajectories of the first class, are described by the probability density 


W2 (x, ) = Wo (x) — Wy (x, t), (2.8) 
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which also satisfies cae (2.4): 


K aw, 
= - — = Lf wal 8 (2.9) 
2 ax 
Using (2.7), we find that (2.8) satisfies the initial condition 
w2(x,0)=0 (x>b) (2.10) 
and the boundary condition 
W2(b, t)= wo(b) (O<t<Ar). (2.11) 


The trajectories of the second class which lie above the level x= 5 at 
time t= At have clearly crossed this level at least once. Therefore the 
fraction of trajectories with a peak beginning in the interval [0, 47] 
which does not end by the time r= Af is equal to 

| W3(x, Af) dx. (2.12) 
b 
This is also the probability of occurrence of such a peak. To find the 
probability that a peak once having begun does not end by time s=rt, 
we have to take account of the loss of trajectories which cross the 
level x= at least once during the interval [Az, t]. As usual, this is 
done by solving equation (2.4) subject to the zero boundary condition 


Wy(b,t)=0 (t> At) (2.13) 
and the tnittal condition 
w3(b, At) = w2(b, At). (2.14) 


Having solved this problem, we can find the probability A P that a peak 
begins in the interval [0, 41] and does not end by the time r=r: 


AP = An = | ws(x,1)dx. (2.15) 
b 


Since the density w, which is the solution of the problem (2.9)-(2.11) 
goes over continuously into the density w, whose behavior for > Af 
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is described by (2.4), (2.13) and (2.14), itis convenient to combine them 
by writing 
w3(x,f)=w2(x,f) (t> Ap). (2.16) 


After making this identification, the function 1,(x, f) salisfies equation 
(2.4), with the initial condition 


w2({x,0)=0 (x>)b) (2.17) 
and boundary condition 
w2(, t) = ¥ 


According to (2.5) and (2.15), the limit of the ratio 1,/A4t as At+0 
will be needed later. This suggests introducing the function v (x, f), 
defined by the formula 


wo(b) for O<t<A4t, 


2: 
for At<tf. (2.18) 


wo (b)v(x,t) = lim ~ “ (x > 6). (2.19) 
4r~0 At 


Using (2.9), (2.17) and oS we find that ae f) satisfies the equation 


a? 


= =U (x) v| fies = ear (2.20) 

subject to the conditions 
v(x, =O (t<0), (2.21) 
v(b, t) = o(f). (2.22) 


After solving (2.20) with the conditions (2.21) and (2.22), the required 
quantity n{z) is found from the formula 


n(t) = Wo (8) [ v2) dx, (2.23) 


implied by (2.5), (2.15) and (2.19). The problem just posed is con- 
veniently solved by using the Carson-Laplace transforin.? In fact, 


2 See H. S. Carslaw and J. C. Jaeger, Operarional Methods tn Apphed Mathematics, 
second edition, Oxford University Press, London (1953), p. xs. 
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the usual rules lead to the formula 
ee 2P 0, 2.24 
— —p= : 
it Kaxt-& Ge) 
where the overbar denotes the transform 
i(x,p)= p | ey (x, dt. (2.25) 
Qo- 
Then the boundary condition (2.22) takes the form 
O(b, p) = p. (2.26) 


The solution of (2.24) contains two arbitrary constants of integra- 
tion. One of these is determined from (2.26), and the other can be 
determined from the condition that the function 0{x, p) vanish at 
infinity: 

b(x,p) 70 as x-+0o (Re p> 0). (2.27) 

Once we have solved (2.24) for 5, we can easily calculate n(z). In 
fact, according to (2.23), the transform of n{z), 1.e., the function 

ma 
ni({p) = p i e "n(t)dt, (2.28) 


0 
is given by 


a 
fi(p) = Wo(b) | D(x, p)dx. (2.29) 
b 
This formula can be wnitten in another form. Integrating the ex- 


pression 
1 a /K a 
jan) = fo 
pox\2 ax 


implied by (2.24), and using (2.26) and the fact that the current 
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vanishes at infinity, we find that 


POP) 4 5 (6)wo(h). 2.30) 


f(p) =—— wo(b) — 
The second term on the right plays no special role, since it merely 
corresponds to the constant f (b) Wo (b) after transforming back to n(z). 
The function n(t) corresponding to (2.30) can conveniently be found 
by using tables of integral transforms.3 
The above method is also suitable for calculating the mean number 
of intervals between peaks which exceed a given positive number t. We 
denote this quantity by »,{t), as opposed to r,(t)=n{t). The only 
difference between the two quantities is that we are now interested in 
the case x(t)<b rather than x(f)> 5, Each case goes into the other 
under the substilution x — x. 


2. Examples 


We now give some examples illustrating the theory developed in the 
preceding section. 
Example 1. The simplest situation corresponds to the absence of 


any restoring force at all: 
f(x) =0. (2.31) 


In this case, the process x(f) is nonstationary, but the theory remains 
the same as before, except that the function wo{x) now depends on the 
time tp. Equation (2.24) takes the form 


v=0 (2,32) 


3 See Bateman Manuscript Project, Tables of Integral Transforms, Vol. 1, McGtaw- 
Hill Book Co., Inc., New York (1954), esp. Chaps. 4 and 5. Also see I. M. Ryshik 
and I. S. Gradstein, Tables of Series, Products, and Integrals, VEB Deutscher Verlag 
der Wissenschaften, Berlin (1957), p. 254 ff. 
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and has the general solution 
2p 2p 
C, exp <— +C,exp4—— x}. 2.33 
Pt | ° P| K ie 


Choosing constants C, and C, which satisfy the conditions (2.26) and 
(2.27), we find that 


d(x, p) = p exp ‘Z (b — sf 


Substitution of this expression into (2.30) gives 


A(p)= ie Wo(b), (2.34) 


and hence, according to (2.28),4 


K 
n(t) = Wo (b) .{ — (2.35) 


2nt 
Thus the number of peaks of duration greater than a fixed positive 
number t is indeed finite, but at the same time, the total number of 
peaks, obtained by taking the limit r—0, is infinitely large. 

Example 2. Next let the absolute value of the coordinate be 
bounded by the number c>b, and suppose no restoring force acts in 
the interval —c<x<c. Then the point x{t) moves as if it were free in 
the “bottom of a potential well.”* The corresponding potential function 


U(x) =- {reeyae 


has the form shown in Figure 3, and can be represented analytically by 


0 for [xl<c, 


vey-f 


The stationary distribution is found to be 


ao for {xl[>c. 


| 4 for [x[ <c, 
Wo (x) "le 


QO for [x[>c. 


4 See Bateman Manuscript Project, op. cit., formula (21), p. 235. 
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Fig 3. The potential function far Fxample 2. 


Equation (2.32) continues to hold inside the well, because of the 
absence of a restoring force, but the values of the constants in the 
general solution are now different. In fact, the probability current 
vanishes at the reflecting wall x=c, and hence 


ov 
9 (<, P) =0 (2.36) 
ox 
It follows from (2.26) and (2.36) that 
cosh ii (c — x) 
d(x, Pp) = —_— -—__. --- 
cosh ie (c— b) 
Formula (2.29) now gives 
A(p)= ie Wy (b) tanh (2 {c — 5). (2.37) 
Therefore® 
Kwo (b) Kt 
=a ——— 9 0 Ee ae ce , 2. 
ne 2(c — 5) 7 "2(c— by ao) 
where 


9,(0, x) = 2x pret kt aye 


® See I. M. Ryshik and [. S. Gradstein, op. cit., formula (5.241.2), p. 261, taking 
account of formula (6.180.3), p. 267 and Sec. 6.186, p. 288. 
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Example 3. We now consider the case of a constant restoring 
force® 


f()=-fo («>b, fo >9). (2.39) 
Then equation (2.24) becomes 


a5 2fp do _ 2p 
poem ours ae 5=0. 2.40 
ae K ax K 2a) 


Of the two linearly independent solutions 


exp {- Us +f fo + 2pK) zt. exp |= Ue — ff + 2pK) zt 


of this equation, only the first satisfies the condition (2.27). Taking 
account of (2.26), we obtain 


b-—x ——— 
B(x, p) = p exp we (fot J fe + 20K), 
which gives 
pk 


ef So +2pK’ 


after substitution into (2.29). Using a table of integral transforms, we 
find that? 


wo(b) fe 702 ie 
n(t) = } Tene” ete (4 x (2.42) 


erfe x = Fler “7 d (2.43) 


A(p) = Wo () (2.41) 


where 


® Cf. (1.46) and the slalionary distribution (1.48). 
7 See Bateman Manuscript Project, op. cit., formula (4), p. 233, noling that 


Da moe 
P 2 BP ltvp:’ 


where 
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These results can also be used when ff, <0, i.e., when the force 
causes the trajectory to move away from the threshold Jevel. tn this 
case, the function (2.42) does not approach zero as t 00. This means 
that some of the peaks which begin in the interval [0, 4s] never end, 
because the curve goes off to infinity, once having exceeded the thresh- 
old. According to (2.42), the mean number of peaks of this kind ts 


n(00) At = Wo(b) [fol At- (2.44) 


Example 4. Of particular importance is the case of a linear re- 
storing force 


x 
£®) ce, px rn ee. 
a 
which, as we know (see p.I.106) leads to a Gaussian Markov process 
with correlation function 


= : —Blcl 
(xx,) ~ 2p e 


and stationary distribution (1.52). Equation (2.24) now tukes the form 


675) 2x di 2 


53 teat at — ap)i=0, 
or 
aa ad . 
peg (2.45) 


where we have the substitution 


= { —-X, 
i ak 
Comparing (2.45) with formula (7.355.3), p. 405, from Ryshik and 
Gradstein’s handbook, we find that the linearly independent solutions 
of (7.45) are 

e”'*D_.(y) and ed (- vy), 


where D_,,(z) is the parabolic cylinder function. Only the lirst of these 
solutions vanishes as yoo, and hence the desired! solution of (2.45), 
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satisfying the conditions (2.26) and (2.27), can be written in the form 


b? _ x? —ap x 
D(x, p) = p exp a ) (2.46) 


2aKk 2 
Do ( 2% 
ak 


Substituting (2.46) into (2.30), and using formula (7.347.2), p. 404, 
from the reference just cited, we find that 


2. 
Ai(p) = wo(b) J = p ed (2.47) 
“?\ I aK 


Before considering the case of an arbitrary threshold level, we 
examine two special cases: 

1. If b=0 we can express n(t) in terms of elementary functions. In 
fact, according to formula (7.341.2), p. 402, again from Ryshik and 
Gradstein’s handbook, we have 


F (q/2) 


Fay (Rae: 248) 


I Fie ja: = 
D_,(0) = wale yA lVdy = 200/2)-1 
a 


Setting first q=ap and then g=ap+1 in this formula, and substi- 
tuting the results into (2.47), we find that 
ap 1 
rl—-+- 


r mL a 
a a re : wo(9) |; 
n(p) = Wo (0)./aK p re : on(@) ,) JaK p r(2 +1) 


(2.49) 


where we have used the duplication formula for the gamma function, 
If we go over to the beta function 


P(x) Py) 


Go a P(x +y)’ 
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using the fact that I ()=/2, then (2.49) becomes 


7 Wo (0) aK ap 11 
= —— [—- pBl|---+-=,. }. 2.50 
n(P) 2 n # z 2 2 a0) 
Noting that® 
pB(p + 4.3)= p [ oe - iy de. (2.51) 
ca] 
we see that the inverse transform of (2.50) is just 
K 
n(t) = wy (0) ie (e7*— 1) 177, (2.52) 
na 
or 
1 ay -1/2 
= — (e°/*% — b=0), 2.53 
nel) (o= 0) (2.53) 


where we have substituted from (1.52). 


2. The opposite case, where the threshold is high, i.e., 
2 2 


> | z > | (2.54) 
= or -3 : 
aK a” 
is of great practical inlerest, Then a large restoring force 
x b 
f(e—"a-” 
a a 


acts on the coordinate when il exceeds the level x=8. As a result, the 
peaks are of short duration, and they exceed x= by only a small 
amount: 
ak 
x(f)-b~ -. 
()-b~"; 
For such excursions above the threshold, the restoring force —x/a 
differs only slightly from —b/a, since, according to (2.54), 
x)— f(b —b ak 
PA TN) ee OE. 
Ff (b) 


b b? 


& Under the subsiltution « = e-', (2.51) becomes 
r 


pB(p + 4.4) =p [ur (1 — u)-!!? dis. 
fA] 
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Therefore the restoring force f(x) can be regarded as practically 
cons(anl, and in fact, selling 


b 
fo=nr, (2.55) 
a 


we can use lhe formulas derived in Example 3. Thus, with the slalion- 
ary distribulion (1.52), formula (2.42) gives (he following mean densily 
of peaks of duralion — (han t 


n(t) = — 5 wold 1 a — erfc J7| 


-T (2.56) 
ae ~pyak] © _ oreo mB i 
2a jnaK fut 
where 
b*x Lb? t 
Sa cri ie 
2a°K 4a°a 


Nalurally, the same resull can be deduced from formula (2.47), bul 
wilh considerably more effort. 

Similarly, we can calculate the mean number n.({t) of inlervals 
belween peaks which exceed tr. The force f= — fix can be regarded as 
conslant for lime inlervals during which x(#) manages (o change only 
slightly compared lo @(x), i.e., intervals t such (hal 


ag 
[ftl<o or ia see 


Using (2.42) with the negalive value {y= —b/a, we oblain the formula 


nz(t) =; 3 Holt) | ae - Vn. (2.57) 


b? 
my 


where 


1 t 
40a 
[cf. (2.56)], which is suilable for T<bja, since then t <aa/b. [| follows 
thal the frequency of long intervals t such that 

2 


ag aa 
Pras (T > 1) 
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equals 


: Wo{d), 


which coincides with the repetition rate (1.56) of peak clusters. Be- 
cause of (1.34), the long intervals have an exponential distribution, and 
hence 


n,(t) ” wo(b) exp {-? wo(b)t “f (=> 4) (2.58) 


Asymptotic formulas like (2.56)-(2.58) can be found in all cases where 
the theory of peak clusters developed in Chap. 1, Sec. 2, is applicable, 
i.e., Whenever the condition (1.45) holds. 

%* Suppose now that no special assumptions are made concerning 
(he.gize of the ralio b/¢. Then we must find the inverse Carson-Laplace 
lransform of the expression (2.47). Using the fact (hal (2.47) is a 
meromorphic funclion, with the partial fraclion expansion 


Pi —— y D apm : oon 
D_.» mE | P — Pm 
—D_a, 
dp P= Pm 
we have 
aK = D,, Aci | OD, 
n(t) = b —-" --@ om Do=— |, @.59 
(z) Wo{ ae Ho — aD), ( q aq ( ) 


where (he numbers p,, = —4,, are the roots of (he equation 


D_,,=D,, =0. (2.60) 


ap 
In all these formulas, (he argument of (he parabolic cylinder functions 
is laken lo be 


2 b 
a 
ak a 

The series (2.59) can also be oblained by finding the solulion 1", (x, f) 
or v{x, t) of the Fokker-Planck equalion (2.9) or (2.20), will zero 
boundary condilions, in the form of an expansion (1.29), and then 
inlegrating wilh respect lo x from b lo oo. The rools A,, turn oul lo be 
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the eigenfunctions of equation (1.30), while the functions D,, are 
proportional to X,,(x). 

A solution of this kind, involving eigenfunctions and eigenvalues of 
equation (1.30), can be found for other forms of the function f(x) as 
well. For example, in the case of Rayleigh fluctuations, the functions 
X,, can be expressed in terms of confluent hypergeometric functions. © 


3. The Unnormalized Probability Density 
of the Peak Durations 


Analyzing the formulas determining the number of peaks of du- 
ration exceeding a given positive number Tt, we easily see that the lotal 
number of peaks, obtained by setting t=9, is infinile. Moreover, the 
formula 


n(t) = (5) (2.61) 


which is exact for f(x)=0, holds for sufficiently small t, regardless of 
the concrete form of the process. In fact, if We Kt>f(b)t, then the 
contribution of f(b), the regular component of the velocity of dis place- 
ment, does not have much of an effect. Therefore, since the majority of 
peaks of duralion exceeding t are short (of order t), (2.61) is a good 
approxiniation if 


apa 
f*(b) 


The fact thal (0) is infinite prevents us from using Formula (2.61), 
defining the normalized probability density w(t) of the peak durations. 
However, although (0) and w(z) cannot be considered separalely, 
their product has a perfectly definite meaning. An expression for this 
product, which might be called the unnormatized probability density, 
can be obtained by differentiating (2.1): 


dn{t) 


n(Q)w()=- (2.62) 
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For the special cases considered in the preceding section. we Sind 


Wo(b) ‘f - 
= +o fe: 2.63 
n(O)w(r)= eo fos (2.63) 
in the absence of any restoring force, 
b) /K see 
n(0) w(t) = sade pas oe Sarak (2.64) 
2 2n 


for a conslant restoring force, and 
B? 
n(O)w(t)=--e "(l—e #0? (2.65) 
7 


for a linear force f (x)= —8x and zero level b=0. 
Because of the absence of a normalized probability density for the 
peak durations, the usual characteristic function 


O(u) = <e"), (2.66) 


salisfying the condition O(O)=1, does not exist. Instead, we can 
consider the combination 


n(0)[O(v) — 1], 


which continues to have meaning in this case. In fact, multiplying (2.62) 
by e“"— | and integrating by parts from 0 to oo, we obtain 


n 


n{0)[O (u) — 1) = iu [ ern) dt =—A(— it), (2.67) 
0 


where the expression on the right is the Carson-Laplace (ransform 
(2.28). Thus the combination n(0)[@()—1] generalizes the charac- 
teristic function, and in some cases is easier to find than the probability 
density itself, e.g., in the case of the linear restoring force leading to the 
expression (2.47). 

Because of the infinite number of peaks, we can no longer talk about 
mean Values, for example, about the mean duration <t) of a single 
peak. However, we can calculate the mean duration of the peaks per 
unit time. Although the quantities »(0) and <t> have no meaning 
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separately, their product is the perfectly well-defined expression 


f=) 
By va 
n(0)<e) = [ m(O)w(o)e de =, (2.68) 
Trot 
0 
which describes the fraction of the time during which a peak is present, 
e., the ratio of the total peak duration to the total elapsed time. 
Using (2.62) and (2.28), we can write (2.68) in the form 


n{O)<t> = { n(t)dt = ' (2.69) 
p=0 
0 
According to (2.67), this is just 
oO 
n(0)<t) = n(0) —— — (= ’ (2.70) 


which is the natural ex pression [forthe usual case of a normalized proba- 
bility density. Using (2.67), we can also calculate higher moments of 
the peak durations. In (act, the usual formulas expressing the moments 
in terms of the characteristic Cunction can be applied, provided we 
make sure that moments always appear in Conjunction with the factor 
n(O), while the characteristic function appears as the combination 
n(0)[© (u)—1]. Thus, for the kth moment we have the formula 


d* 
n(0)<e"> = xem (O)[O(u) — 1]] @.1) 


Finally, we calculate the fraction of the time occupied by peaks of 
duration less than t,. By definition, this quantity equals 


Teun (2 < T) es yr c 
a f= { meoywe )t-dt: 


Substituting (2.62) and integrating by parts, we find that 


Teall < Ty) 


Troe 


-{> (t)dt — t,n{t;). (2.72) 
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In particular, if t; is much smaller than the other time constants of the 
system, then, according to (2.61), 


Tpeak(T < Ty) a Ee 
ac mee ere (2.73) 


Thus the fraction of the time occupied by short peaks ts sinall, even 
through there are infinitely many such peaks. A similar formitla holds 
for the intervals between peaks. 


4, Relation between the Distribution of Peak Durations and the 
Correlation Function of the Triggered Process 


The statistical properties of the peaks are intimately connected with 
those of the process 4(f), called the triggered process, equal to | in the 
presence of a peak [x(#)>6] and to O in the absence of a peak 
[x(#)<b]. The process y{(#) clearly consists of a sequence of pulses 
whose durations coincide with the peak durations, and can be ob- 
tained by applying a zero-memory nonlinear transformation ro the 
original process, i.e., 

y(t) = ILx(t) — 5], (2.74) 
where 
1 for z>0. 


ee { for z<0. 

In the case where x(#) is a Markov process, it is easy to see (by the 
definition of a Markov process) thar the duration of a peak, or of an 
interval between peaks, is statistically independent of the duration of 
neighboring peaks or intervals, and correspondingly, the peak and 
interval durations of the triggered process are independent random 
variables. In Chap. [.6, Sec. 5, we studied a pulse sequence of this 
kind, and found its spectral density. Applying formula (1.6.130) or 
(1.6.131), we can establish the connection between the correlation 
function k,(t) of the triggered process and the distribution of peak du- 
rations and intervals, described by the functions 0,, O, or 7;, #,. Using 
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the identity 


-I 
(1- @,)(1- 2) _ [s. Pe ae 1 75) 
1-— 0,0, 1-0, 1-0, 


and noting that <@+¢) ~' coincides with (0), the average tota] number 
of peaks (or intervals), we write (1.6.130) in the form 


iim 


-*}. epee See eine eee eee at 
pp lnO)[t— Orfip)] n(O)[1— O2(ip)} n(0)J ’ 
which implies 


dk, )_f ie 
nt| - i | lnm tnol ieee 


where we have used (2.67) and the fact that n(0)=0o for an exact 
Markov process.® Formula (2.77) can be used to determine one of 
the functions k,, ny and mn, whenever the other two functions are 
known. In the special.case where the level b ts “symmetrically located,” 
ie., is such that 


(2.76) 


ny (2) =m, (1) = n(2), 
(2.77) reduces to 


T 


pt ~ at P| = 4i(p), 
and hence 
dk, (t) _ 
dt 
The correlation function k,(t) figuring in the above formulas is 
usually regarded as known. In particular, we can use formula (1.4.65), 
obtaining ; 


~2 n(t). (2.78) 


k(t)= ¥ Ag pe alt 
dk, ee co 7 hh2 (2.79) 
L = —; =) mr rrr ; 
| dt r X pt+aAn 


® The use of formula (1.6.10) in the case where 2(0) = © will be justified in the 
hext section. 
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where 


a0 


h = { X,, (x) dx, 


5 


in terms of the eigenfunctions X,,(x) of the Fokker-Planck equation 
(1.4.51). 

In the case where the original process x(r) is Gaussian, it is Con- 
venient to use another formula. Substituting (1.3.14) into the obvious 
identity 

ow 


k,(t) = [ [tex ~ w(x)w(x)Jdx dx,. 


bb 
and carrying out the integration, we obtain 


k,(t) = a ae (2.80) 


P 
where 


1 : 
F(zj)=-,) - | e "dex. 
“) Jan | 


lc Follows that 


WO RF ro ") 7 RT 
dt p=l a} \ (p—1)! 
where 
i dR 
dt 
Using (1.3.14) again, we find that 
ae Ro? w(b,b) (2.81) 
dr 
or 
eal ae Ne ee go eete (2.82) 
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In the case of a Markov process, we must set R=e7 **, but (2.82) holds 
for any Gaussian process, whether or not it is Markovian. 
Example 1. First let 6=0. Substituting R=e~* into (2.82) and 
using (2.78), we find that 
n(t)=--——= : anf eh 1) Me (2,83) 
n it n 
which agrees with (2.53). 
Example 2, Next let b>. In the region of small values of t, where 
1 — RSo7/b’, we can replace the expressions | — R? and (1 — R)/(1+R) 
by 2(1 — R) and i — R)/2, respectively. Then, writing (2.82) in the form 


dk, R b7 1-R 
meee ii -_-—~ ——}, 2.84 
ae F = FW ( ao FieR ee) 
we find that 
dk, oWo awa (b) R =e —R)f4at (2.85) 
dt 2/x J1-R 
When integrated, this “ik 
es 
k(t) = — ew (b) ere (> J! - 2) : (2.86) 
20 


where the complementary error function is defined by (2.43). In the 
case of a Markov process, we can write 


1-R=1-e "=r 


in the region of small t, and then (2.85) becomes 


dk Bo tee 
a - jowa(b) [Be te alee (2.87) 
Using a table of Laplace transforms,?° we find that 
dk, opp pK 
pt| - Sip |= wo(b) 
0) TS Pipe? oo tak 


(2,88) 


10 See Bateman Manuscript Project, op. ci#., formula (3), p. 144. 
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which, together with the expression (2.41) for A, (p), with fo=fib, and 
the analogous expression for &,{p), with fg= -- fip, actually satisfies 
equation (2.77). 


5. Peaks of a Smoothed Process 


Since exact Markov processes are never encountered in practice, it 
is Of interest to show how the results obtained above can he extended 
to the peaks of a smoothed process. Suppose the stnoothing is described 
by the formula 


y= [ec —r)x(t)dr, (2.89) 
where the “weight function” G(r) has the following properties: 
[eo dt=l, (2.90) 
G(t) 20, (2.91) 
G(r) =0 for |t[ >t. ~ [eo [tl dr. (2.92) 


An example of such a process Is 


1 
( —— for [t|<t,., 
G(r) = 2 


QO for [t| >t. 


In the case of the exponential function 


( een for 40; 
G(r) = 


a 
0 for t<O, 
the condition (2.92) can be regarded as effectively satisfied, starting 


from 32!_, say, so that G(r) =0 for t>7,,=31),. 
It is easy to see that a smoothing operation of the kind just described 
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cannot destroy a peak or an interval whose duration exceeds 21,,,, and 
accordingly, such peaks or intervals will be called “long.” In fact, it 
follows from (2.89), (2.90) and (2.92) that 


t+ tem 


y()-—b= [ee —?)[x("’) - bj dt’ = { G(t—?r')[x("’) — b]dr’. 


1— tam 


But the last integral is greater than zero because of (2.91), provided 
that x(f’)—b>0 in the interval t—t,,<f'<t+t,,,. Therefore the 
smoothed process y(t) is sure to have a peak in the middle of a “long” 
peak of the unsmoothed process, and the same is true of intervals. 

As far as “‘long”’ peaks are concerned, the smoothing operation can 
act in three ways: 

1. It can change the duration of a peak (or interval) by an amount 
not exceeding 2r,,,. This eflect is unimportant if the duration t is much 
greater than 2z,_. 

2. It can form a “long’’ peak (or interval) out of ‘‘short’” peaks and 
intervals. However, according to (2.73), the short peaks and intervals 
occupy a fraction of the total time equal to 


1 K 
7. [Treat (t < 7 Pe + Tint (t < Qin) = 2wa{b) eo 


If t,,, is sufficiently small, this fraction is small, and hence the statistics 
of long peaks and intervals is only slightly changed even if all the time 
occupied by short peaks and intervals is converted into long peaks and 
intervals. 

3. It can merge ‘‘Ilong” peaks (or intervals) which are not separated 
by “long” intervals (or peaks), thereby forming a single peak (or 
interval). This effect can be examined by neglecting the first two 
effects and ignoring ‘‘short” peaks and intervals. As a result, we obtain 
the expression 
i, (p) =- my (2am) Mia (Pp) 

14 (2tan) + Hy (P) 


for the distribution function f,(t) characterizing the peaks of the 
smoothed process, where n,(t) is the corresponding function for the 


(2.93) 
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unsmoothed process. (There is an analogous expression for the in- 
tervals.) [t follows from (3.93) that the difference between #,(z) and 
n, (t) can be neglected if tm <T. 

Thus smoothing with the time constant f,,, has practically no effect 
on the distribution of peaks of duration t >t,,,, and for such peaks 
(and interyals) we can use the results obtained earlier. The total 
number of peaks of the unsmoothed process is finile, of order 17, (21,,,,). 

Applying formula (I.6.130) to the triggered process #(1) with “short” 
peaks and intervals excluded, we find that 


i| - She|=| ao + sal (2.94) 
dt fiy(p)  72(p) 


If we now pass to the limit t,,,0, then f(r) goes into the exaci process 
y(t), and (3.94) goes into (3.77). This justifies the formal application of 
(1.6.130) to a process with infinitely many pulses. 

To investigate the behavior of the function fy (zt) for t ~t,,,, as well 
as for t> t,,,, we must take account of the concrete form of the function 
G(t). It turns out that if t,,, is much smaller than the other time con- 
stants of the system, then, after smoothing, the asymptotic formula 
(2.61) is replaced by 


F(@) = 4w0(0),/ ss r( : ), (2.95) 


NAT on 2s 


where f (z) is a monotonic function which is the same for all Markov. 
processes in the diffusion approximation (see p. 1.103), depends only 
on the form of G(z), and has the properties 


for z>l. (2.96) 


” 
“ 


fO~S()~1, fees 


Supplement 


* Since the calculations leading to the last few formulas are rather 
complicated, we give some of the details here: 
1. After excluding peaks and intervals shorter than 21, the peak 
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durations can be described by the probability density 


1 dn, (t) 
Ny (2% sm) dt 


for t>2t,,, 
w(t) = | 
Similarly, for the intervals we have 


1 dn, (t) 
ny ek dt 


for t>2t,, 
Ww, (t) = 


0 for t <2t,,- 


[CcH. 2 


(2.97) 


Here the mean number of peaks per unit time is m,(2t,,), while the 
mean number of intervals is n(2t,,,). The fraction of the total time 


occupied by peaks is 

M1 (2T yn) <1 > = Ny (2T ym) [mm (t)dt, 
while that occupied by intervals is 

Ny (2T sm) (ba) = Mg (2 on) | tw, (t) dt. 


It follows that 
Ny (2T sm) (tT + Mg (2T 3m) <T2) =I. 


(2.98) 


For sufficiently small t,,,, the mean numbers of peaks and intervals are 


approximately the same, i.e., 


K- 
My (2 sm) ad Ny (2T sm) od 4Wo (b) = > 
and therefore (2.98) becomes 


ny (21...) = 


(ty) + Ct) 
Using (2.97), we obtain the characteristic function 


ne | re A) 
Ox ) Se Je 


(2.99) 


(2.100) 
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———s vials fe ee 


2tam 
which implies 
ni fu 
O,@) s1- arom 2.101) 
if |u| ts not too large, ie., if |u| <1/2t,,. 

Because of the exclusion of ‘‘short” peaks and inlervals, it is no 
longer necessary for a peak to be followed by an interval, and in fact, 
a peak can be followed by another peak. The occurrence of a peak or 
an interval is an event which is independent of whether a peak or an 
interval occurred previously. Because of the (approximate) equality 
Ny (2t.m)="2(2t,,), the probability of occurrence of a peak or an 
interval always equals 4, Consider a peak preceded by an interval. 
The peak is ‘“‘solitary’’ (followed by an interval) with probability 4, 
“double” (followed first by another peak and then by an interval) with 
probability 4, “triple” with probability 4, and so on. Therefore the 
probabillty density of the “‘merged”’ peak, extending fromm one interval 
to the next, is 


W1(t) = 44, (t) + [ wicedonte —%)dt, 
+ # [ [ macesdone (ea) Wy (T— Ty — Tr) dTy dt, +... 


Going over to the characteristic function, we have 
6, (u) = 40, (u) + 407 (u) + 40} (u) +.. — aaron tos, (2.102) 
— i 
Substitution of (2.101) into (2.102) gives 
My (2m) ~ i (— it) 


Ny (2T ym) + Hy (— bad) 
Next we find the mean duration 


Ct) = [races = [SP (2.104) 
p p=0 


of the merged peaks, which we then compare with <7,>. Substituting 


6, (u) = (2.103) 
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(2.102) into (2.104), we obtain 
; 1 — 0, (ip) 
¢7,) =2lim —-—-  -*? - , 
"no P[2— ©, (ip)] 
which implies 
So a (2.105) 
since 
fae Pl 
P70 


T1>- 
Applying a similar argument to the intervals, we find that 


ny (2% an) — fia ({— iu) 


82 (u) = 11 (2T 5m) + fi, (— iu) 


and 
(iz) = 20). (2.106) 


The mean number of merged peaks (or intervals) per unit time ob- 
viously equals 


Ay (2%.m) = Ay (24.4) = > —o- 
1 { ) 2{ ) 71) ve <t) 
Together with (2.100), (2.105) and (2.106), this implies 


fi, (2t,,,) 1, (2m) (2.107) 


2k tin) 2 

Finally, to calculate the unnormalized distribution ,{t) of the 
merged peaks (with respect to duration), we need only use formula 
(2.67), replacing the quantity (0) by the finite density of merged peaks 
Ay (2%;,): 


A, (p) =A, (2t,,,) [1 — 6, (ip)]. (2.108) 
Then substitution of (2.103) and (2.107) into (2.108) gives the desired 
formula (2.93). 
2. To prove (2.94), we apply (1.6.130) to the process # obtained by 
excluding “‘short’’ peaks and intervals. In terms of quantities pertaining 
to merged peaks and intervals, we have 


L| ~ F:0| =< 1 [1-61 (ip) 1 — 62 (ip) 
: de? \ 7 ey + ay 1 Gi (in) Ga (ip) 
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Just as in the derivation of (2.76), the right-hand side can be written 
in the form 


1 { 


=f 
Fees [1—O,(ip) (Qe) [1 — Oz lip) os 
Using (2.108), we find that 


-1 
pt| - he |-[ so tee =~ =| (2.109) 
de fis(p) ” fia(p) (26) 
To obtain (2.94), we need only substitute (2.93) and the analogous 
expression for #,(p) into (2.109), taking account of (2.107). 

3. When a Markov process is smoothed with time constant 21,,,, 
the number of peaks of duration t>2r,,, remains practically un- 
changed, while the number of peaks of duration t~2r,,, changes but 
not in order of magnitude. Therefore 


fiy (2T,,) ~ My (2T im) - 


The shorter peaks (t<2t,,,) are practically all smoothed out, and 
hence 
Ay (0) ~ hy (2T 5m) ~Hy, (27 mn) is (2.1 10) 


The exact value of 7, (0) depends on just how the smoothing is carried 
out, but as an order of magnitude estimate, (2.110) Nolds for any 
smoothing. Since 


K 
ny(t) © Wo(b) Js (2.111) 


[cf. (2.61] if c is appreciably smaller than the other time constants of 
the system (of order 7p, say), the relation (2.110) takes the form 
K 
Ay (0) ow Ay (2T 5m) Led swo(6) ' (2.1 (2) 
RT om 


[Together, (2.99) and (2.107) serve as an example of this formula. | 
At the same time, as shown in Sec. 5, 


A(t) n,(t) for t> 2r,,. 
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Therefore, according to (2.111), 

fi, (t) = v(t), = for 2t,,<t™<Tp. (2.113) 
Introducing an interpolation function f(z), we can combine (2.112) 


and (2.113) into a single formula (2.95), Then it is easy to see that 
(2.112) and (2.113) imply the relations (2.96).* 


CHAPTER 3 


Smoothly Varying Noise 
and its Effect on Relays 


In this chapter, we examine the case of smoothly varying noise, 
which is the opposite of the case of Markov processes considered in 
the preceding two chapters. Every actual process x(/) is characterized 
by a time constant f,,, describing the length of the Lime intervals 
At<St,, during which the process is smoothly varying. Our previous 
considerations show that x(t) can be replaced by a Markov process if 
Tsm is considerably smaller than the other time constants characterizing 
x(t), for example t,,,. However, t,,, is sometimes of the same order of 
magnitude as t,,,, ¢.g., When the spectral density of the noise falls off 
rapidly with frequency. Two spectral densities exhibiting this behavior 
are 


40° ane 
S[x;0] = Jnew# 


and 
4 f2no7/f for o<f, 
S{xia] =| 0 for w> Ff. 


In fact, using the estimate t,,,~x/x, we find that 


=)" -(s80)"- 


for each of these densities, while on the other hand, cach also has 
Teor ~ 1/B [ef. (1.2.7) ]. Since the spectral densities encountered in radio 


St 
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engineering can quite often be approximated by such functions, the 
case of smoothly varying noise is of great practical interest. 

The theoretical investigation of peaks of smoothly varying noise 
entails considerable difficulty because of the non-Markovian character 
of such processes. To simplify the problem, we shall assume that the 
threshold level x= 56 is high. To justify this assumption, we recall from 
p. 20 that the operating level of devices such as pulse counters is 
usually much higher than the scatter of the noise fluctuations, i.e., 
b—<x)> a(x), since otherwise the excessively large perturbations in- 
troduced by the noise would impede the normal operation of the 
device. 


1. The Distributlon of Peak Durations 


The quantity 9, equal to the average total number of peaks of 
smoothly varying noise, has already been found in Chap. 1, Sec. 1. 
Therefore, according to formula (2.1), to determine n(z), the average 
number of peaks of duration exceeding t, we must now find w/(z), the 
probability density of the distribution of peaks with respect to duration. 
For a smoothly varying process x (7), we can write the Taylor expansion 


x(t) = x(fo) + X(to)(t — to) +H 2(to)(f— toy t-., GL) 


where the series converges very rapidly if t—t) <t,,,, in fact, approxi- 

mately like a power series in (t—t9)/tsm [As always, t,, is the time 

constant characterizing the rapidity of the fluctuations of x(t). ] 
Suppose fy is the time of inception of a peak, so that 


X{(fo) = 5. 


Then if the time which has elapsed since fy is sufficiently small, we can 
confine ourselves to just three terms in the expansion (3.1), obtaining 


X(t) = b +X (to) (t — to) + E¥(to)(t— to)’ - (3.2) 


Thus, for small intervals t—%p, the curve x(t) is shaped like a parabola 
(3.2), and can intersect the level b, thereby completing a peak, before 
its deviation from parabolic shape becomes appreciable. Of course, at 
low operating levels, such ‘‘parabolic peaks” constitute only a small 
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fraction of all the peaks. However, the mean duration of the peaks 

decreases as the operating level is increased, and at a sufficiently high 

level, the peak durations will as a rule become less than r,,,. Then the 

peaks will be predominantly of parabolic shape, as described by (3.2). 
If t denotes peak duration, then 


x (to + t) = 5 A 
which, because of (3.2), implies 


xt +47 =0, (3.3) 
where 


X=X(to), X= X(to)- 


It follows that in the present approximation, the peak duration t is 
very simply related to the first two derivatives of the process x(f) at the 
time of inception of a peak, i.e., 


2* (3.4) 
t=—2--. : 
x 


Since the initial value of X is positive, formula (3.4) is applicable only 
for negative values of X, and in fact, it is only in this case that we can 
neglect the higher-order terms in the expansion (3.1). However, it is 
not hard to see that the second derivative ¥ will be negative with 
overwhelming probability if the condition b— <x) >oa(x) is satisfied. 

Let w,(x, X) be the joint probability density of the first and second 
derivatives of x(t) at the time of inception of a peak at the level 6. Then 
we can easily express w,(X, X) in terms of the thrce-dimensional 
probability density w(x, 1, X) of the coordinate x and its lirst two 
derivatives, taken at the same time. The result ts 


ad ad for &>0, 


W(X, X) = | i w(b, x, X)xdx dX (3.5) 
O86 for *¥ <0, 


in complete analogy with (1.4). In fact, to verify (3.5), we need only 
repeat almost without change the argument leading to (1.4). 
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Given the joint distribution (3.5), it is an easy matter to find the 
probability density w(t). Using (3.4), we go from the variables x, X to 
new vanables x, t: 


x x 
w, (x, X)dx ax = m(s = 2 ‘)a Zz dxdt. 
tT t 


Then integration with respect to x gives the final result 


F . x x * 
w(t) = 2 wi(é —2 *) 3 dx 
0 (3.6) 


wo 
= 2 [ w(t, —2z)zdz (t>0). 
0 


Because of the way it was derived, this formula is valid for small 
Posilive values of t, for which the discarded terms in the series (3.1) do 
not play an important role, If the operating level is sufficiently high, 
(3.6) is valid for all the frequently encountered peaks and failsto describe 
only the long peaks, which occur with low probability. 

To illustrate the application of formula (3.6), we now consider a 
Gaussian random process x(r), with mean zero and correlation func- 
lion 


(xx,) = 0?R(2). (3.7) 


Because of the assumption that x(r) 1s smoothly varying, the correla- 
lion coefficient has the senes expansion 


I I 

R()=1 — 5 Rat? + Rat? —... (3.8) 
d7*R (0) 

Ry, = (- 1)‘ det? (3.9) 


which converges rapidly for values of t such that the higher-order 
terms in (3.1) can be neglected. To find the three-dimensional proba- 
bility density w(.v, x, ¥) figuring in formula (3.5), we first calculate the 
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correlation matrix 


Cx?) Ck) xX) ‘| | 0 —-R,| 
(xx) <8?) XH] =07! O RR, 0 
Cx) C¥X>  <¥?S |-R2 O Ry | 


where the mean values <xxX), (%.¥), etc., are easily obtained by 
differentiating the correlation function (3.7) and then set(ing t=O. It 
is apparent that the first derivative x is not correlated with cither + or 
x, and hence is independent of x and %, since x(t) is Gaussian. Corre- 
spondingly, the three-dimensional probability density can be written 
as a product 


. (3.10) 


w(x, X, ¥) = w(x) w(x, x). (3.11) 


Using the correlation matrix (3.10) and the fatniliay formula for the 
multidimensional probability density of a Gaussian process in terms 
of the correlation matrix [see Chap. 1.3, esp. formula (1.3.3)], we find 
at once that 


it s 2 
w(x) => ee i m2 (3.12) 
,/2n0?R, 

Rgx? + 2R3xt + saa 
sa rg OXP Y — ——55---" = ; 
2na*/R, — R? 2a7(Ra—R3) J 

In the same way, by comparing (3.5), (3.11) and (1.4), we sec that the 
probability density w,(x, ¥) of the initial values of x and ¥ factors into 
a product 


w(x, X)= (3.13) 


where 
: RX cgaypcs : ; 
w(x) = oR. labia eee (0-1!) (3.15) 


is the probability density of the first derivative + at the time of in- 
ception of a peak [eff (1.4), (1.7), (1.8)], while 


. w(b, %) 1 I (¥ + Rab)} 
b) = pe = ha ie » ade 
eC ai) /anc?(R,—R3) | 207 Ry RS oe 


is the conditional probability density of the second derivative ¥ ata 
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given level b. Integrating (3.6) with respect to t and using (3.15), we 
obtain the distribution of the peak durations in the form 


F(t) = [vo dt = 2[ — @7 77/20°R2) w(_ 27/b) dz. (3.17) 


Substituting (3.16) into (3.17), we use the formula 


ao 


[evra ds = YR ene (- q/p) (3.18) 
Pp 


[cf. (2.43)], where 


lee (3.19) 
a ge (Re Re): 
first setting 
2 
Pe ay pds 
a(R, — R3) 
and then 
[ 4 1 
= .- ~———z~ + — |, 
PY 2a7\R,— Ri” Ry 
The result is 
b -1/2 
2F (1) = ete — =, — (: + rR) 
V2y (3.20) 
b? Rt? f b 1 Y R - 
x ex 5° erfe4 — < t : 
PY 207 44 Rye egn ac? 
where 
R, — Ri 
= = 3.21 
Y R? (3.21) 


Formula (3.21) is valid for values of t which are small enough to 
allow us to use (3.2) instead of (3.1), dropping all terms of order 3 or 
higher. The rate of convergence of the series (3.1) depends on that of the 
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series (3.8). Therefore the condition for applicability of the approxi- 
mation (3.2) can be written in the form 


Rat? <1, yRat? <1. (3.22) 


These inequalities can be used to deduce simplified (but less accurate) 
expressions from (3.22). Thus, taking account of only the first 
t-dependent term in [1+(yR.17/4)]~+, ie., writing 


4(4 + yRat”)' = 1 — 4yR27’, 
2(4+ yRyt?) 1? = 1 — dyR,0? 


in (3.20), we obtain 


b ——— 
2F (t) = ere} ~ a - (1 = R,«*] 
a ./2y 8 
b? b y 
x exp} — Ral eel T(t gm’) 


At low operating levels, the width of the region of applicability of 
the results obtained above is only a small fraction of the mean peak 
duration <t), and hence these results can be used only to calculate the 
density of the rare short peaks. As the operating level is increased, the 
mean peak duration becomes smaller and falls into the region of appli- 
cability of our formulas, which can now be used to calculate the rate of 
occurrence of almost al] the peaks, except the very rare long peaks. In 
other words, in this case our results determine the shape of alinost the 
whole distribution w(t), except for an unimportant “tail” correspond- 
ing to small values of w(t). 

Suppose the condition 


(3.23) 


(3.24) 


b? > a, (3.25) 


characterizing a high operating level, is satisfied. Then (3.24) gives a 
Rayleigh distribution for the peak durations, i.e., 


w(t) = — sar exp {- Jak ; (3.26) 
a a 
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Correspondingly, the most probable value of + equals 26/b,/ R, 
while the mean peak duration is 


- 20 
(Tt) = 2b JR,’ (3.27) 


Using the expression (1.9) for the average total [requency of occurrence 
of peaks, we find that the number of peaks of duration exceeding r is 
given by 


R. 2 2 
n(t) =a,[1 -— F(t)] = = exp {- - (: + ur}. (3.28) 


There is another, easier way of deriving (3.26): According to (3.16), 
the conditional mean square deviation 


o (x) = [f(¥ + Rpb)? w(x]b) dx]? =o. /R,—R2 (3.29) 


is much less than the conditional mean value — R,b, because of (3.25). 
Therefore the second derivative X at the time of inception of a peak can 
be regarded as nonrandom and equal to — R,b. Thus the peak du- 
ration (3.4) becomes 


t= — ik, (3.30) 


and is determined entirely by the size of the first derivative x, which 
has the distribution (3.15). Then, making the simple change of variables 
(3.29) in (3.15), i.e., writing 


b 
w(t)dt = n> Rss); R, dt, (3.31) 


we immediately arrive at formula (3.26). 

Finally, it should be noted that the above method for finding the 
distribution of peak durations is applicable not only in the case of 
Gaussian noise, but also in any other case where the three-dimensional 
probability density w(x, x, ¥) can be calculated. 
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2 Other Methods for [Investigating Peaks of 
Smoothly Varying Noise 


2.1. Another way of finding the distribution of peak durations starts 
from a calculation of the correlation function (2.74) of the triggered 
process. In the case of slowly varying noise, the durations of the peaks 
and intervals are correlated random variables. Therefore a formula 
like (I.6.130) is not valid for low and moderate operating levels, and 
the results obtained by using (I.6.!30) can only serve as a rough guide. 
However, at high operating levels, the mean interval length between 
peaks is much greater than t,,, or t,,,. and the correlations disappear, 
allowing us to use (1.6.130) or (2.76). 

Thus, when the intervals between peaks are much greater than t,,, 
(on the average), we can neglect correlations. Then it is a good ap- 
proximation to regard the initial times of the peaks as having a Poisson 
distribution (cf. p. 1.144). Therefore the intervals have the probability 
density 


W(t) = 1g e7™ (3.32) 
[cf. (1.6.34) ], and hence 
0, (ip) No 
ip)=-- --. 
2\!P ptno 


Substituting this expression into (2.76), we find that 


es ad rel 3.33 
mt S| loin — 


Because of the inequality 
l 
C(t) < a (3.34) 


0 
which means that the mean peak duration is much smaller than the 
mean interval duration, the term n/p in (3.33) is much smaller than 


the term 
J 1 


1-O,(ip) <t)p +... 
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if p~1/<r>, and can therefore be neglected. Then (3.33) becomes 


pL} - P| = Ao [1 — @, (ip)] = A(p) 
[ef. (2.67)], or 


= (0) =n (t) = No { w(t) dt. (3.35) 


This formula differs from (2.78) only by the absence of the factor of 2, 
and can be written in the form 


(x) 1 d?k,(t) 
N= - : 
e No dt? 

For example, suppose x(s) is a Gaussian process. Then according to 
(3.35) and (2.84), 


n(t) =— gyi) 


Pan 


2 
w(t) = a | = exp ‘- 2 —*\) (3.38) 
JR, dtLJ/1 = R? 207 1 +R 
[cf. (1.9)]. If b>o, 1— R<1, we can replace the correlation coefficient 
R(t) by 1—4R,t?. Then formulas (3.37) and (3.38) reduce to (3.28) 
and (3.26), respectively. 

2.2. A general solution of the problem of calculating the distri- 
bution of peak durations can be found by using the theory of corre- 
lated random points developed in Chap. I.6 (esp. Secs. 1 and 4), 
which leads to an expression in the form of an infinite series. In 
practice, this series can be used only to obtain approximate results, 
since the amount of calculation required to achieve a given accuracy 
grows rapidly as the accuracy is increased. However, in some cases, 
e.g., for moderate operating levels and smoothly varying noise, this is 
the only suitable method. 

Suppose the process x(f) has a peak beginning at the time t=, =0, 
so that 


(3.36) 


R b>? 1—R 037 
—$$$1p¢ ==; ————— ; 
/1 — R? PL 207 1+ Rf’ ) 


and hence 


x(0)=b, %x(0)>0. 
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Subsequently, the curve x(t) may intersect the threshold level several 
times. Suppose x(¢) makes downward crossings of the level 1 = b (going 
from the region above x=b to the region below x = +) at the points 


t,, so that 
x(tj)=b, X(t) <9. (3.39) 


Then the points ¢, form a system of identical random points, described 
by the distribution functions 


fi (t1),f2 (15 t2), aod (lis Stayt?) 69 


Using the definition (1.6.1) of these functions, and following the 
derivation of formula (1.3), we find that 


0 0 
Sti of = J ore | Weond(b, X45 ---2 Ds Xp) LE yf---1X ax, .- dX, 
Se (3.40) 


where 


c ‘ _ Jb rar (Bs X01 Fu ++ Vis Xe) odXo 
Weond (X15 yy 0219 Xp, =—_—-: -- 0 


Jowy (b, Xo) Xad Xo : (3.41) 


and 
We e1 (X05 Kor oes Xp Xp) = w [x (0), %(0), ...,x(1,). ¥(,)]. 


The system of points (3.39), defined for ¢>0, is nonstationary even 
when x(t) itself is stationary, and in fact belongs to the category of 
“switched-on”’ processes (see p. J.132). However, for 1>1,,,, (3.39) 
becomes a stationary system (see p. I.147). For such values of ¢, the 
conditional probability density (3.41) coincides with the unconditional 
probability density, and the functions f,(t,, -.., t,) depend only on the 
lime differences. In particular, f, (t,) reduces to a constant 


f,=Mo (3.42) 
and f, (f;, f2) to the function 


9 oO 
fr(ty-t,) = i { w,(b,%1,b,%2) [4] [Fal dk, dk, (3.43) 


—D~-® 


depending only on f, — ft. 
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The duration t of a peak is the distance from the origin to the ‘‘first” 
randoin point f,, i.e., the random point nearest the origin. If the peak 
duration z exceeds 1,,, then no point at all falls in the interval O<s<rt,. 
The probability of this event is 


o 


P{r>+,} = fro dt, (3.44) 


Tin 


which, according to (I.6.13), can be written in terms of the generating 
functional as 

P{r>t,}=L,,[-1], (3.45) 
where 


L[-1]=1+ FY [folie neta ..dt., (3.46) 


by (1.6.4). The last three formulas, together with the symmetry of 
F (tis ++» ¢,), imply 


w(t) = ae i Tf (i (tly) ---1f,-4) dt, ...dt,_4. (3.47) 


r=1 


The probability density w(r) can also be expressed in terms of the 
correlation functions g,(t,, ..., £,), related to the distribution functions 
by the formulas (I.6.7). In fact, it follows from (3.44), (3.45) and (1.6.9) 
that 


freracnerol— (renee 3S 2. fot A Pee at 


(3.48) 


[n the case of smoothly varying noise, the derivative x(¢) cannot 
change sign rapidly. Since the time it takes x(¢) to change appreciably 
is of order t,,,, there is only a very small probability of two neigh- 
boring intersections having a separation t<t,,,. Therefore the dis- 
tribution functions f,(t,, t2), fy(41, fs fs), --. take Small values at 
neighboring instants of time, i.e., 


Sy liye fy) <fi (ty)... Sy (t,) (ry = 2, Bye) (3.49) 
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if [t;—4;[ <t.o, for all i, 7. Consequently, if <r,,,, the only important 
term in (3.47) is 
w(t) =f, (t). (3.50) 


Thus, if the operating level b is high, so thal the mean peak «uration is 
very much less than t,,,, formula (3.50) gives a satisfactory solution of 
the problem, since then it correctly describes the behavior of w(t) for 
the [requently occurring peaks. The formula breaks down in the region 
T~Teo,, COrresponding to the infrequently occurring peaks. Jt should 
be noted that according to (3.40) and (3.41), in order to obtain the 
distribution (3.50), we have to calculate the integral 


a oO 


Nof,(t) = J { w (b, Xo, b, X,) Ky [Xf dX dX,. (3.51) 


0-27 


where X= x(0), X,=<(t). 

*In the case of a low or moderate operating level, it is important to 
know the probability density w(t) in the region r~t,,,. Study of this 
region entails calculation of higher-order terms in the series (3.47) or 
(3.48) and evaluation of multiple integrals of the form (3.40), and hence 
leads to technical difficulties. These difficulties can be avoided to a 
certain extent by the special device of expressing the higher-order 
correlation functions g,(t;, ..., £,) in terms of lower-order correlation 
functions. In so doing, we assume that the higher-order correlations 
are Characterized by the same correlation time as lower-order corre- 
lations, and we express all the correlation functions in terms of the first 
two, f.e., f,(0 and g2(t,, f,). At the same time. the actual system of 
random points is replaced by a system of the kind considered in Chap. 
6, Sec. 4. To illustrate the method, we solve the problem of determining 
w(t) in the approximation corresponding to a system of nonapproach- 
ing points (See p. I.160), making use of the approximation (3.49) which 
states that the probability of points being separated by small time 
intervals is small. 

Thus we begin by Setting 4; =...=4,, obtaining the rclations 


Stat) =0 (FS 2-325) (3.52) 
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which allows us to determine g,(f,, .-., f,). In fact, substitution of 
tp =...=f,, 7,=...=2, in (1.6.6) gives 


wD 


BT ee(las nfs) 24 =In[1 +f (t1)Z1]- (3.53) 


r=1 
Then, expanding the logarithm in series 
Sd cee 
In(1 +f1z,) = Lu 2 Siz1> 


r= 


and equating coefficients of like powers of z, in (3.53), we find that 
Br (tay -erts) =(— I(r — DUT). (3.54) 


Similarly, suppose we choose distinct but neighboring time instants 
ty, fy .-. (where (¢;—¢,|<z,,,) and distinct z, in formula (1.6.6), and 
then neglect the terms in f2, fy, ... as before, using (3.49). This gives 


B(fy ot) =(- VW Nr - DY) Aire) (Fr =2,3,...), (3,55) 


where |f;—f,| <t,,, for all i, j. 

These relations are good approximations if the correlation is strong. 
In fact, let R(t,, t2) be the correlation coefficient of the original process 
x(t). Then for coincident times t; =...=1,, when the correlation is total 
and R becomes unity, formula (3.54) holds exactly. For [t,—t,| <t,o,, 
we have R(t, ¢;,) 1, and the relations (3.55) hold approximately. As 
the intervals between points are increased until they are of order T,,,, 
the correlations which only extend over intervals |f,—t,|~7,.., begin to 
disappear, and correspondingly, the functions g,(f,, ..., f,) describing 
these correlations, and the function R(z,, t,), grow smaller. If at least 
one of the differences [¢,—¢,| is much greater than 7,,, and if the corre- 
sponding value R(t, t;) is approximately zero, then the correlation 
function g,(f,,...,f,) will be approximately zero. This suggests ap- 
proximating g,(t,, ..., ¢,) by an expression containing the correlation 
coefficient R. One such representation is 


Bt ot) = (I(r DY) AA GIR (tata) Ra Des 
(3.56) 


where, as on p. I.19, the symbol {...}, denotes the operation of 


SEc. 2] SMOOTHLY VARYING NOISE 65 


symmetrizing the expressionin brackets with respect to all its arguments, 
and is introduced to make g,(f, ..., f,) salisfy the necessary symmetry 
conditions. If the correlation coefficient is smoothly varying and 
satisfies the conditions 

R(t,t,) = 1, (3.57) 


J IR (tata) dty ~ Foor (3.58) 


then the correlation functions (3.56) salisfy the conditions (3.54) and 
(3.55), and moreover vanish, as required, if at least one difference 
Itt, > Tear 

Setting r=2 in (3.56), we obtain the formula 


G2 (ty.ta)=—S italy (to) R (tte), (3.59) 


which we use to define the correlation coefficient R(f,, /). Then the 
other relations (3.56) will be approximations for r>2. Using (1.6.7), 
we can write (3.59) in the form 
t,t 
Rote 
AiG hi (2) 


It is easy to see thal the condition (3.57) is satisfied because of (3.52), 
while the condition that R be smoothly varying guarantees that the 
process x(t) is smoothly varying. The condition (3.58) is merely a 
definition of the correlation time, which, for subsequent purposes, it ts 
convenient to replace by 


(3.60) 


lim [ R@ut)ar, = Toor? (3.61) 


§t7o@ 


instead of the approximate formula (3.38). 
To find the distribution w(x), we must still substitute (3.56) into 
(3.48), or else use (1.6.64) which gives 


{ w(t)dt =e 5, (3.62) 


t 
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where 
t 


Se be cc a 


These formulas can be used both for small and for large values of r. 

If t<t,,,, we can Set R=I in (3.63), which allows us to bring the 

integrand, except for the factor f, (1), in front of the integral sign. This 

pives w t 
[ »@ar- l -{f (t) dt, (3.64) 
t 0 

which is equivalent to (3.50). In the opposite case, where t>,,,, 

formula (3.63) can again be drastically simplified. For values of t such 


thal 
ID Tog, TE > Teor 


(i.e., which are far from both the beginning and the end of a peak), we 
have ¥ e 


{ RG, OV (jdt = {Ro t) no dt’ = Noteors 


0 0 
because of (3.42) and (3.61). Therefore (3.62) and (3.63) imply 
ic (x) dz = const e!%(1 ~“noreer)"”""°" = const-(1 — Mote)". (3.65) 


Tt 


For intermediate values t~r,,,, there is a gradual transition from the 
behavior described by (3.64) to that described by (3.65). 

According to (3.40) and (3.60), calculation of the correlation coef- 
ficient R(f,, fz) entails evaluation of a triple integral involving the 
probability density w4(xo, Xo, X45 1, ¥2» X2). This can be avoided at 
the cost of diminishing the accuracy of the result, by replacing f2(f,, f2) 
in (3.60) by the limit function (3.43). Then 


18] 0 
l * . . * * * 
R(t1,f.)= R(ty—-ta) = 1 - “{ { w2(b,X,, b, %2)(X,| 1%, dX, dX, 
0 


—-o —-@ 
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and the calculation of R(t) is of the same order of difficulty as that of 
f(D) [ef G.51)].* 

2.3. As we have just seen, although it is very difficult to calculate the 
exact distribution of peak durations, several approximate formulas, of 
varying degrees of complexity, are available for the case of high thresh- 
olds b>o. As the threshold is lowered, these formulas all break down, 
but some remain better approximations than others. To ilhistrate the 
extent to which the theoretical formulas continue to apply when the 
ratio b/a is not very large, we now conSider some experimental data. 
The distribution of peak durations for a Gaussian random process 
with spectral density 

1 o 
ees ores a for a, <la|/<,, 
0 otherwise 


WO, 3 
—=f, = 440 ke/sec, _~ =f, = 10,250 kejse } 
2n 2n 


03 
02 


O1 


0 
5S Wt 


Fig. 4. Theoretical and experimental distribution of peak durations for 6= 1.690. 
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2 4 6 BT 


Fig. 5. Theoretical and experimental distribution of peak durations for b = o. 


and threshold b= 1.69 is shown in Figure 4, while the distribution for a 
Gaussian process with correlation function o2e~”"* and threshold 
b=ca is shown in Figure 5. In each case, the solid curve represents the 
experimental data.! 

The simplest theoretical formula (3.26) gives a Rayleigh distribution, 
and the corresponding points are indicated in the figures by triangles. 
This formula is not as accurate as formula (3.38), which gives rise to 
the points indicated by circles.2 Here the agreement between theory 
and experiment is satisfactory even for b=o. Finally, the curves in 
Figure 5 indicate the results of calculations based on formulas (3.50) 
and (3.51). These calculations, which are more tedious than the others, 
also lead to satisfactory agreement with experiment. 


3. The Area under the Peaks 


The operating level 6 has so far been defined as the mintmum value 


1 See V. I. Tikhonoy and I, N. Amiantov, Probability densities for the duration of 
noise peaks, Radiotekh. 15, 10(1960). An English translation appears in the volume 
“Non-Linear Transformntions of Stochastic Processes,” edited by P. I. Kuznetsov, 
R. L. Stratonovich and V. I. Tikhonov, Pergamon Press, Inc., New York (1965), 
p. 382. 

2 The derivation of (3.38) makes essential use of the assuniption that the peak and 
interval durations are independent random variables. 
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of the “input coordinate” x(t) needed to activate the relay. If x(t) is 
sufficiently slowly varying, then the relay will actually operate every 
time x(t) first exceeds the level b. However, depiartures [rom this rule 
are observed in practice, because of the finite, nonnegligible rate of 
change of x(), i.e., some peaks fail to activate the relay and as a result 
“go unnoticed.’ The assumption made on p. 21 to the effect that the 
relay operates jf and only if the peak duration exceeds a certain length z 
is not always a salisfactory approximation to the true state of affairs. 

Special studies of the effect on electronic relays of piilses of various 
shapes support the conclusion that the following rule is the most 
reliable: There exists a level b and a minimum area S,,. which depend 
only slightly on the form of the pulse, such that the relay operates every 
time the area “under the pulse (peak)” exceeds S,. Here we have in 
mind the area bounded above by the curve x(t) and below ly the line 
x= b, as shown in Figure 6. The calculation of the area is asstimed to 


Reloy 

operates 
Relay does not 
operate 


——_——_—— _— 


o t 


Fig. 6. The area under peaks of random poise. 


begin anew every time x(t) makes an upward crossing of the level b. 
Of course, this condition for the functioning of the relay is nol exact, 
but it does adequately describe the operating characteristics of a wide 
class of relays, especially in the case where the input signal has a 
tendency to make well-separated crossings of the threshold. 

The requirement of a minimum peak area rather than a minimum 
peak duration takes account properly of the fact that even a very short 
pulse can cause the relay to operate if the pulse is very strong. In other 
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words, the minimum area requirement takes account not only of the 
peak duration but also of the extent to which the peak exceeds the 
threshold, and hence can be regarded as a requirement imposed on the 
“energy” of the peaks. 
As before, let t denote the peak duration, starting from the time 
t={). Then the operating condition just introduced takes the form 
tott 
Ss { [x(t)— b]dt>5S,,, (3.66) 
fo 


where the quantity S will be called the excess area. The mean number 
of omitted or ‘“‘skipped"' peaks can be simply expressed in terms of the 
distribution of the peaks with respect lo the excess area: 


Sin 


Nsrip = Ng i w(S)dS = noF(S,,). (3.67) 


0 


Since the total number of peaks 71, has already been found [recall (1.5) 
and (1.9)], it only remains to calculate the quantity w(S). In so doing, 
we assume, as before, that x(¢) is smoothly varying and that the oper- 
ating level is sufficiently high. 

As noted in Sec. |, the peaks of sufficiently short duration are of 
parabolic shape, and are described by the first three terms of the 
Taylor series expansion of x(¢): 


x(t) = x(to) + X(to)(t — fo) + 4X (to)(t — to)”. (3.68) 


Here the duration of the peak equals 


x 
de er 
x 


where X=X(fo), ¥=*X(to) [cf. (3.4)], while the excess area is given by 
the integral 


t 
1 2 3 4 xe 
s=|(is+)e*)ae= 35 +#o= = (3.69) 
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As before, we use the expression (3.5) for wi(*. ¥), the probability 
density of the first two derivatives at the lime of inception of a peak. 
This leads to the following expression for the probability density 


of the excess area: 
ceo] 


w(S) = (3) 5-7" { w[GS)P=*,2°]2"dz. (3.70) 


0 


Formula (3.70) enables us to calculate the mean number of skipped 
peaks (3.67), even in the case of low operating levels. provided that the 
minimum area is sufficiently small, i.e., S,,<1,,0(¢). However, for 
high operating levels, the evaluation of w(S) can be greatly simplified. 
For a Gaussian random process, with mean zero and correlation 
function (3.7), the second derivative at a high threshold v=/ is 
practically nonrandom, and equals <= —R,h (see p. 58). Thicrefore 
the excess area (3.69) is determined entirely by tlie size of the first 
derivative: 


S= ce 3.71 
3 R2b?° on) 
According to (3.15), x has the distribution function 
x? 
F(x) = 1 ~ exo} - ef, (3:72) 


and hence, after making the change of variables (3.71), we find the 
following distribution function for the excess area: 


1/3 b? ets 
F(s)=1-e0|-3(5% Ja.) } (3.73) 


The probability density corresponding to (3.73) equals 


1/3 b? ,--\"P __ 1/3b7 ne 
w(s) =3(5 svi) Ss 1/3 op {—5(3 7+ R3S) i (3.74) 


2 


and is shown graphically in Figure 7, in terms of the constant 
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w(S ip 


1 2 3 oS 


Fig. 7. The probability density of the excess area of the peaks. 


To find the fraction of skipped peaks, which do not activate the 
relay, we need only substitute the minimum area S,, into (3.73). Then, 
subtracting the result from the average total number of peaks and 
recalling (1.9), we obtain the number of peaks which actually cause the 
relay to operate: 


(3.75) 


aes) 


207 


It is apparent from (3.75) and (3.28) that the insensitivity of a relay 
to low-energy or short-duration peaks is equivalent to an increase in 
the operating level by a quantity which depends on the properties of 
the noise, more exactly on 


d’R(0) 
dv 
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4. Effect of Pulse Signals on a Relay in the Presence of Noise. 
The Dead Time 


Electronic relays are used to register and count pulses of known 
shape s(t), which together constitute a useful signal s,(). usually 
contaminated by the presence of additive noise €(r). This is the case 
when relays are used in digital computers, in radar equipment with 
digital display, in devices for measuring the intensily of radioactive 
radiation, in apparatus for the precise measurement of short time 
intervals, in various systems for coding, pulse synchronization, auto- 
matic control, etc. 


Fig. 8. Circuit diagram of an electronic relay. 


AS an example, consider Figure 8, which shows the circuil diagram 
of an electronic relay with a single equilibrium state. Let the input 
signal be the voltage x(r)=s,(t)+€(z) between the grid and cathode 
of the first tube T,. In the absence of an external voltage, the relay is in 
a state of stable equilibrium, with the tube 7, drawing no current 
because of the bias voltage produced in the resistance #, hy the flow 
of anode current I,, through the tube T,. As soon as the external 
voltage acting on the grid of the tube T, reaches a certain crilical value 
b, the relay “trips,” i.e., the tube 7, begins to draw current and the 
tube T, ceases to draw current. Every time it operates, the relay 
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t 
Fig. 9. Behavior of voltages in the relay of Fig. 8. 


produces a voltage pulse across the resistance R; this voltage U., subse- 
quently discharges through the condenser C and the tube 7, until it 
reaches the value £,, at which T, begins to draw current. When this 
happens, the relay returns to its original state. The evolution in time of 
the sequence of events just described ts shown in Figure 9. 

The parameters of the useful signal, in particular the height of the 
pulses of which it consists, are chosen in such a way that each separate 
pulse activates the relay. Therefore, in the absence of noise, the relay 
operates a number of times exactly equal to the number of pulses 
appearing at ils input. The presence of noise produces a twofold effect: 
In the first place, the relay sometimes operates when no pulse is present, 
ie., a peak of the contaminating noise may be misinterpreted as a 
signa! pulse; this effect will be called a “false alarm.” Secondly, a 
Signal pulse may be “skipped” altogether; this happens when the sum 
of the signal and noise turns out to be too small to activate the relay. 

The average total number of false alarms due to noise peaks in the 
absence of signal pulses is the quantity n, already found in Chap. | 
[cf. (1.5) and (1.9)]. If the relay does not respond to all the peaks, but 
only to those of sufficiently long duration (t>z,,) or of sufficiently 
large excess area (S>S,,), then we can use formula (3.28) or (3.75), 
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provided the noise is smoothly varying and the uperating level is high 
enough. However, in deriving these formulas, we ltave not yel laken 
account of a characterislic feature of relay operation, i.e., the existence 
of a “‘dead time.” This is just the period of lime during which the relay 
is still undergoing the transient produced by ils response lo an earlier 
pulse and hence is not yet ready lo respond to a new pulse. Any new 
pulse arriving during this period will be skipped. The siniplest way of 
dealing with this phenomenon is lo assume thal there exists a lime 
conslant t, characterizing the minimum interval thal must elapse 
between initial poinis of peaks before the relay can respartd to a new 
pulse. In other words, a pulse satisfying all tte other requirements will 
not cause the relay to operate ifthe interval between its initial point and 
the initial point of a previous pulse which activated the relay ts fess than 
t,. Of course, more complicated behavior is possible, and the require- 
ments for reaclivaling the relay (e.g., the minimuin excess area) may 
depend continuously on the time since the last activation of tlre relay. 

The effect just described compels us lo takeaccount of thedisiribulion 
of the lengths of intervals between peaks. The complicated problem of 
calculating this distribution can be simplified in the case of a high 
operaling level, where the correlation between the dillerent peaks 
becomes weak. Then the only peaks which are appreciably correlated 
are separated by short lime intervals Arst,, (st for “‘short time’’). 
Here 1,, is a kind of correlation time for peaks, and describes the region 
of enhanced conditional probability of a new peak occurring, given 
that a previous peak has occurred. This correlation line decreases as b 
is increased, and for b— <x) >o(x) becomes much less than the corre- 
lation time 1,,, of the original process x(t). Tor large time intervals 
At>t,,, we can neglect the correlation between peaks, regarding the 
appearance of different peaks as independent events. This absence of 
correlation corresponds to a Poisson distribution 


W (Tiny) = tg eT (3.76) 


for the intervals T;,, between adjacent peaks (because of the short 
duration of the peaks, T,,, is approximately equal to the interval be- 
tween initial points of adjacent peaks). For T,,,<t,, the probability 


density w(T;,,) has somewhat larger values than given by (3.76). For a 
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sufficiently large dead tiine t, >1,,, this effect can be neglected and the 
different peaks can be regarded as uncorrelated. 

Making this assumption, we now calculate the number of [alse 
alarms, with due regard (or the dead time. Let 1, be the mean number 
of times the relay operates (in the absence of signal pulses), and let n 
be the same quantity tn the absence of any dead time effect. Then 
during a time T, the relay operates n,T times, and each operation of the 
relay gives rise to a dead time t,. To take full account of the effect of 
the dead time, we need only note that the relay is insensitive (or a total 
time equal to n, Tz,, and hence capable of responding only for a time 
equal to T(! —n,t,). During this time, nT(1—n,T) peaks occur which 
are capable of causing the relay to operate, and these peaks actually 
cause the relay to operate n,T times. It follows that 


nT =nT (1 — nyt,), 


or 
: 3.77) 
ny, = : ; 
E> nat, ( 
If nt, <1, the effect of the dead time is slight, and we have 
hy =n—n't,, (3.78) 


which is close to n. In the opposite case, where nt, > 1, formula (3.77) 
gives #, ~1/t,. This is natural, since the interval between successive 
operations of the relay cannot be less than 7z,. 

The presence of signal pulses increases the total time during which 
the relay is insensitive, and this decreases the number of false alarms 
compared to (3.77). In (act, if m, is the actual rate of false alarms in 
the presence of signal pulses, and if the latter occur at the rate n,, then 
the total dead time is now n,Tt,;+n,7Tt,. Subtracting this expression 
(rom the total lime and multiplying by n, we again find the actual 
nuinber of false alarins: 


noT = n(T _ n TT, = n,T 71) . (3.79) 
It follows that 
I —- at; 


: 3.80 
L+nt, ( ) 


n= 
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This formula is valid for any relation between #,1,, ar, and unity, 
provided, of course, thal (#,+”)1t,<1. In most practical cases, there 
are comparalively few false alarms, f.e.. 1, <#",, and then we can use 
the condition nz; <1 to deduce from (3.80) the approxtinate formula 


n, =(1—a,t, —nt,)n + O(t7). (3.81) 


As already noted, the quantily ” figuring in (3.77)-(3.81) can be found 
by using the formulas derived earlier. 

Having considered the case of (alse alarms, we now Lurn Lo the other 
effect of noise on relays, t.e., the skipping of signal pulses. As a rule, 
pulses are skipped rather rarely, and in fact, the height and length of 
the signal pulses are generally chosen to be quile large, in order to 
keep down the number of skipped pulses. Here we give only a quali- 
lalive formula, suitable for evaluating the raie at which pulses are 
skipped, since there is hardly any practical need for a more exact 
formula, 

Suppose the pulse has a rectangular shape and begins al time zero: 


(B for 0<¢t<t,. 
(0 otherwise . 


s(t) = (3.82) 


The voltage at the input of the relay is the sum of s(f) and the con- 
laminaling noise &(t) [see Figure 10]: 


x(t) = s(t) + (4). (3.83) 


S(t) 


Fig. 10. An input signa) equal to the sum of a rectangular pulse and contaminating 
noise. 
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Suppose the relay has operating level b< B. (We ignore niceties 
connected with minimum peak duration or minimum excess area.) 
Then a signal pulse will be skipped if and only if the curve x(7) lies 
below the level b during the whole pulse, i.e., 


E(t)<b—-B (3.84) 
(or O<r<T,. IF we were only interested in the probability P of this 
inequality holding al one instant of time, then obviously 
6-8 
P= J w(t)dé. (3.85) 
However, we need to know the probability of (3.84) holding at any time 
during the pulse, and this is a more complicated problem. By par- 
litioning the interval [0, T], the probability of (3.84) holding in the 
interval [0, T] is given formally by the integral 
6-85 b- 8B 


P= J hs J wLE(t,),---0€ (ty) ] dE (0,) ... de (ty) 


(Q<t,<...<ty <T), 


(3.86) 


which it ts difficull to evaluate. A simple, but not very precise formula, 
which is suitable for practical purposes, can be obtained by replacing 
€(1) by a random step function which changes ils values by jumps after 
intervals of the order of t,,, (see Figure 11), where we assume that the 
values of the function ¢(r) are statistically independent even when only 
one jump apart. 

With this assumption, the probability (3.84) equals some power of 
the integral (3.85). For example, if t, =0, (3.86) coincides with (3.85) 


t 


Fig. 11. Approxjmation of continuous noise by a random step function. 
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and hence equals the first power of (3.85), while if t,=t.o, (3.86) 
equals the second power of (3.85), and so on, with the exponent under- 
going a jump whenever f, is an integral ntultiple of 1,,,. Thus, for 
integral values of z,/t,,,, we have 


b-B L+(tp/tcar) 
P= | { w(€) a =[F,(b — B)]iteet” (3.87) 


and we continue {o use the same formula if t,/z,,, is nol an integer. 
Assuming thal the effect of the additive noise ort eaclt pulse fs stalisti- 
cally independent of ils effect on the other pulses, we conclude that 
(3.86) and (3.87) give the fraction of skipped pulses. If the average 
total number of skipped pulses per unil time equals »,, then the 
number of skipped pulses, which do noi “trip” the relay, cquals 


Askip = NyLF,(b — B)]! Tt ritew”) (3.88) 


while the number of times the pulses cause the relay to operate ob- 
viously equals 
n (3.89) 


op = Np — Aship . 


In the case of Gaussian noise with mean zero and variance a7, we 


have 
I vr 2 
Ww é = erties : 
() ; 


and hence 


26 


I B-— b [+ tpftear) 
Nain =",| - erfe—-- 3.90 

ace “is aa 
Formula (3.90) shows that the number of skipped pulses prows as 
B— bis increased or as the pulse duralion is increased compared Lo the 


F,(b — B)= werk @- ") 


It follows that? 


3 If the correlation coefficient R(t) = e-?!™!, then rear =! /y, wiijleifR(z) = eo 4", 
then tear = Vv nida = V to [cf (1.2. 7)]. 
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correlation time. In the case B—b>o, we can use the asymptotic 
formula 


iat 
erfc x = ——, 
as 
obtaining 
o 1+(tp/tcor) Be b 2 
er eC ee ee 
/2n(B — b) 20 Teor 


5. Jitter of Relay Operating Time Due to the Presence of Noise 


There are many applications in which an electronic relay is used to 
produce an output pulse whenever a signal pulse s(1) is applied to its 
input. Besides false alarms and skipped signal pulses, the presence of 
additive random noise produces still another effect. We refer to “jitter” 
of the relay operating time, i.e., instability of the moment at which the 
relay responds to a signal pulse at its input. In the absence of noise, it 
can be assumed that the relay always begins to operate at the same 
point of the waveform s(r), so that the time fy at which the relay oper- 
ates can be used to locate the exact position of the input pulse along 
the time axts. The presence of noise leads to a random time shift of the 
output pulse relative to the input pulse, and hence f, can no longer be 
used to deduce the exact time of arrival of the input pulse. Of course, 
noise in the relay itself (e.g., power supply instability) leads to the 
same effect, since such noise causes instability in the operating level b. 
However, by ascribing this internal noise to the random input signal, 
we can regard the operating level b as constant. 

Thus, in any event, suppose a signal of the form 


x(t) 5, (0) +E (1) 


is applied to the input of an ideal relay, where €(t) represents random 
noise, and, as before, s, (f) is a sum of pulses of standard form: 


s, (t) a 20 t,). 


Consider a single pulse s(é), choosing the ‘‘centering time” ¢;=0. To 
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calculate the jitter in the relay operating time, we arguc as follows: The 
Operating time ¢,, in the presence Of noise is the moment at which the 
curve x(t) crosses the level b, and hence satislics the equition 


S(top) + & (lop) = b. (3.92) 
If €(t)=0, equation (3.92) reduces to 
s(to) = 6, (3.93) 


where f, is the operating time in the absence of noise. Subtracting 
(3.93) from (3,92), we obtain 


u(t,,) + €(t,,) = 0, (3.94) 
where 
U (lop) = $ (top) — S(to). 


The signal pulse and the noise are both smoothly varying functions, 
since they arrive al the relay input only after going (through some 
system with finite bandwidth. Therefore the rate of change of s(r) and 
(rf) is characterized by some time constant 7,,, which means that the 
terms of the Taylor series of s(¢) and €(r) fall off like powers of the 
ratio Aft/t,,. 

The next step is to solve (3.94) for the operating time f,, by using 
the method of successive approximations, under the assumption that 
the noise ¢(t) is weak. To make the method of solution more trans- 
parent, we equip the random function €(r) figuring in (3.94) with a 
smal! parameter ¢, wriling (3.94) in the form 


u(t,,) + €€(t,,) =9. (3.95) 


Then at the end of the calculation, we sel e=1, bearing in mind that 
the method of solution is justified by the smallness of €(1).4 
Thus, writing the solution of (3.95) tn the form 


lop = lg tety tet, t+..., (3.96) 
and then substituting (3.96) into (3.95), we have 


u(ty tet, tet? +...) +e€(to tet, +...) =0. 


4 This statement will be made more precise later. 
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After expanding the functions u and € in Taylor series, this becomes 
u’ (ty) (et, + e7ty +...) + 4u” (to) (et, + e7t2 +...) 
+... + €E(to) +66’ (fo)(et, +...) +... =0 
[recall that u(t.) =0]. Equating the coefficients of identical powers of 
the parameter c, we obtain the consecutive approximations 
wt, +€=0, 
ut, + 4u"th + &'t, =0, (3.97) 


ier (3.98) 
u 
& Iu” a Oi ad 
alan ieee ea ae we) 


Finally, recalling (3.96), we write the solution of (3.95) in the form 


é cc” ae 
lop toe +e a og + O(e), 
or 
GC) ee” eee 
Dee Penge ie aisle es ae ‘ 
op to s’ 7 5’? 95°3 3 (3 100) 


where we set =! and neglect terms of order 3 or higher. 

It follows from (3.100) that the operating time is shifted by an 
amount depending on the derivatives of the functions s(t) and €(t) at 
the time t,. The first term in the right-hand side of (3.100) stems from 
the first approximation, and the other two terms give the second-order 
correction. An analysis of (3.100), and also of the higher-order approxi- 
mations, leads to the conclusion that the successive approximations 
converge like powers of the ratio ¢'/s’, which equals o(¢)/s’t,,, in order 
of magnitude. Here we use the (act that each differentiation of s and € 
is in order of magnitude equivalent to dividing by the “smoothing 
time” z,,,. Thus the method of successive approximations will be very 
effective if 
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We conclude ths section by using the above resulls to calculate 
the statistical characteristics of the time shift (3.100) for the case of 
Gaussian noise with zero mean and cortelation funclion ¢€€)= 
o” R(t). Averaging (3.100), we obtain a nonzero mean shift 


(top — to = — —o*, (3.101) 


proportional to the second derivative of the pulse waveform. The 
quantity s’’ is usually negative, since the operating level is usually 
closer to the top than to the bottom of the pulse s(t). Therefore 
<top— to) >0, i.e., On the average the noise produces a sinall time lag 
in the operating time of the relay. Moreover, taking the square of 
(3.100) and averaging the result, we find that 


2 
o? otR, 30*s” 


D (tz, —f)= ey + ar 48°" (3.102) 
where 
d’R (0) 
R,=- 
: dt” 


In deriving (3.102), we have used the statistical independence of ¢ and 
é’, and the first of the formulas (1.8.31). It is apparent that the jitter of 
the operating time ts largely determined by a, the standard deviation of 
the noise, and s’, the steepness Of the signal wavefront. The second- 
order corrections, Which depend ons” and R, (and hence on the rate 
of change of the contaminating noise), lead to further instability of the 
relay operating time. The convergence of the serics for D(t,,—!9), 
whose first few terms are given by (3.202), is characterized by the 
parameter o7R,/s’. 

Equation (3.100) can also be used to make an approxiinate calcu- 
lation of the probability density of the time shift ¢,,-—19. For con- 
venience, we first introduce the dimensionless quantity 

lop — to _§ go’ i 


t= —— = + a) (3.103) 
Co o os’ 20s'~ 


instead Of 4,,— fp. In the first approximation, where t= — ¢/a, we have 
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a n0rmal! distribution 


w(t) = Ten, (3.104) 
fn 


The other two terms in (3.103) modify the distribution (3.104). The 
larger of these corrections to (3.104) is due to the term 


In fact, substituting (3.103) into the characteristic function <e’"") and 
expanding the resull in a series with respect to 

are ne? 

==, 


f 


os 2oes 
we obtain 


’ Ww 2 
cel’) = (erm(1 + ior — tv 52 : + =) - (3.105) 


When the average is carried oul, the term in €¢’ disappears, since €’ is 
independent of € and ¢é’) =0. Afier dropping this term and the higher- 
order terms indicated by +..., (3.105) becomes 


ce") = Ge ey te _ ay? we i- m/e, 


jer 


Taking the Fourier transform of (3.106), we obtain the probability 


density : 
os” { a 6 I : 
wi)=[ 1+ Sa(3 3+: =\|= Tra eur 
f OT In 


os” I A 
=|1+ —(22-1°)|-—e*". 
i aya ) Jan 
If necessary, the same method can be used to derive (urther corrections 


to the distribution of zt. It should be noted that the corrected distrj- 
bution (3.107) is no longer symmetric. 


(3.106) 


(3.107) 


PART 2 


Nonlinear Self-Excited 
Oscillations in the Presence of 
Noise 


CHAPTER 4 


Basic Equations Describing the 
Operation of an Oscillator in the 
Presence of Noise 


1. Prellminary Remarks 


Sine wave generators are used for a variety of purposes in contempo- 
rary engineering practice, e.g., for producing the carrier {requency ina 
radio transmitter, for changing the carrier frequency of the input 
signal in a superheterodyne receiver, for producing standard signals 
for applications to radio astronomy, radar, navigalion, eic. The sine 
wave generators employed in radio engineering vary preatly as to the 
generated f{requency, the power, and the physical process used to 
produce the self-excited oscillations. However, a common [feature 
of all such oscillators ts that they use positive feedback, which must 
be strong enough to amplify and sustain the initial perturbations. 
Another characierislic feature of most oscillators is the presence of a 
(requency-selective element (a tank circuit), with a resonant (requency 
near that of the generated frequency. Without such an element, the 
self-excited oscillations, instead of being sinusoidal, would have a 
more complicated form, like the relaxation oscillations of a multi- 
vibrator or blocking oscillator. 

Various physical phenomena can be used to produce self-excited 
oscillations, and correspondingly, the basic equations describing the 
Operation of the oscillator can be quite diverse. In this book, how- 
ever, we shall confine ourselves exclusively to the case of oscillators 
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whose operation is described by a second-order differential equation. 
Such an equation can always be reduced to the form 


% =fq(x,%,8), (4.1) 


where x(r) is some coordinate, e.g., the voltage or current in a given 
circuit element, while fy(x, %,1) is some function whose form is 
determined by the specific nature of the Oscillator, i.e., its circuit 
diagram.! Examples of such functions will be given below. 

As already suggested, there are generators which cannot be described 
by a second-order differential equation. For example, if the frequency- 
selective elenient consists of several resonant circuits, the basic equa- 
tion may be of order higher than 2. In other instances, the oper- 
ation of the oscillator may be described by an integro-differential 
equation, as in the case of oscillators which use semiconductor devices. 
Finally, the generation of ultra-high frequency oscillations in dis- 
tributed-parameter systems is described by partial differential equa- 
tions which reduce to ordinary differential equations only in certain 
approximations, These more complicated situations will not be dis- 
cussed here. 

The oscillators considered in this book all belong to the category of 
s renerators, ie., oscillators whose Output is close to being 
sinusoidal. There are two ways in which the output of such a device 
may fail to be sinusoidal. In the first place, there are high-frequency 
deviations. In this case, the output signal is close to a sine wave of a 
certain amplitude and phase during one Or several periods, but takes 
values both above and below the sine wave, with the deviations corre- 
sponding to a frequency higher than the basic frequency of the oscil- 
lator. These high-fiequency deviations are smal! in absolute value, or 
else can be made smal! after prelintinary smoothing. Secondly, a signal 
can differ from a site wave because of slowly varying but constantly 
accumulating deviations of amplitude and phase, which are small for 
one Or several periods, but, after a large number of periods, the ampli- 
tude and phase change completely, and the signal goes into a new sine 
wave, different from the original one. This second kind of departure 


I As usual, the overdot denotes differentiation with respect to time. 
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from pure sinusoidal behavior is often more important than the first, 
since in the Circuits usually encountered in cnginccring practice, the 
high-frequency deviations are as a rule filtered out, und hence are of 
interest only insofar as they affect the slow changes of amplitude and 
phase. 

Now let wy be an approximate angular frequency, determined from 
a few arbitrarily chosen ‘“‘periods”’ of the oscillations. If the generated 
signal x(#) were purely sinusoidal, it would satisfy the equation 


X= — wox. (4.2) 


Clearly, if x(t) is not a pure sine wave but if the deviations of the kinds 
just discussed are small, then the right-hand sides af equations (4.1) 
and (4.2) differ only slightly. To clarify the situation, we introduce a 
small parameter ¢ and write 


fo(x, %,0) = — wax + ef (x, % 0). 
Then the equation (4.1) satisfied by the oscillations becames 
+ wox = ef (x, x, 0). (4.3) 


All that has just been said is also valid in the case where external 
or internal excitations are applied to the circuit elements. This ts taken 
into account by having f depend explicitly on r. Such excilations may 
be regular, as in the case where a voltage pulse is applicd te the anode 
of a vacuum-tube oscillator, thereby generating a high-frequency signal 
pulse. Another example is the case where a periodic external excitation 
is used to stabilize (synchronize) the oscillator (tequency. On the other 
hand, there may also be “‘irregular’’ excitalions, duc to instability of 
the circuit parameters, power supply instability, internal sliot noise and 
thermal noise, as well as external random noise, and in all such cases, 
the time-dependent excitations must be described statistically. Then the 
generated signal! will also be a random function of time, whose statisti- 
cal characteristics haye to be determined. 

From a mathematical standpoint, in the presence of random ex- 
citations, equation (4.3) represents a nonlinear equation containing a 
random function. However, because of the smallness of the parameter 
&, equation (4.3) is only slightly nonlinear, and essential use of this fact 
is made in solving the problem. Exploiting the smallness of ¢, we can 
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use asymptotic methods, which allow us to obtain results in the form 
of expanstons with respect to € to any order. 


2. An Example of a Self-Excited System. 
The Vacuum-Tube Oscillator 


As an example of a self-excited system, consider the vacuum-tube 
oscillator with the circuit diagram shown in Figure 12. Here the anode 
circuit contains an LC-circuit, and the capacitances C, and C, are 
chosen to have negligibly small a—c resistance, while, on the contrary, 
the resistance R, is quite large. Therefore Figure 12 is equivalent to the 
simplified circuit diagram shown in Figure 13, where the constant 
anode voltage and grid bias are not explicitly indicated. 


9+ 500v 


Fig. 12. Circuit diagrain of a vacuum-tube oscillator. 


Fig. 13. Simplified circuit diagram corresponding to Fig. 12. 
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Denoting the current in the inductive branch of the /.C-ctrcutt by /, 
and equating the voltages across the tnductive and capacitive branches 
of the circuit, we obtain the equation 


L V+ R= Ale — dt 


or 
I+ wel = — woRCl + wil, (4.4) 
where 


ic 
Next we express the anode current J, in terins of the current /. For a 
given grid bias and anode voltage, the anode current is a known 


function 
I, = F(U,, U,) (4.5) 


of the a-c componeitts of the grid and anode voltages. By introducing 
the coefficient D (the reciprocal of the amplification factor), this de- 
pendence is often represented as a function of one variable, ‘e., 


J,=F(U), where U=U,4+DU,. (4.6) 


If we negieci the gad current, the ac component of the grid voltage 
will be determined exclusively by the e.m.f. introduced by the presence 
of the mutual inductance Mf: 


U, = Mt. (4.7) 


The a-c component of the anode voltage equals the voltage across the 
LC-circuit, taken with the apposile sign. Using this fact. and substi- 
tuting (4.6) and (4.7) into (4.4), we finally obtain the following basic 
equalion describing the operation of the oscillator: 


I+ wel =— weRCI + woF(M/ — DLI— DRI). (4.8) 


Equation (4.8) is of the form (4.3), but the right-hand sicle does not 
explicitly depend on time. Time dependence will appear if we take 
account of internal noise or introduce external excitations. For ex- 
ample, because of fluctuations due to shot noise, the instantaneaus 
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value of the anode current /, differs by a random amount from the 
average anode current <J,> corresponding to the grid and anode 
voltages at the given instant. In fact, equations (4.6) and (4.7) hold 
only for the average anode current 


Ja) = F(U, + DU,), (4.9) 
and the actual plate current 
I, = F(U, + DU,) +1,(1) (4.10) 


has an additional fluctuational component /,(r), whose spectral densi- 
ty is given by formula (1.6.41). Substituting (4.10) into (4.4), we obtain 
the equation 


P+ wo! = oo[—- RC] + F(MI — DLI — DRI) +1,()], (4.11) 


which differs from (4.3) by the presence of an extra fluctuational term 
in the right-hand side. If we set D=0, thereby neglecting the reaction 
of the anode load, (4.11) simplifies to 


P+ wel =wo[— RCL + F(M) +1,(8)]. (4.12) 


The effect of the anode load can be largely taken into account by re- 
placing M by Mf’=M— DL in (4,12). 

Next we consider external excitations, which can be introduced in 
various ways. Jn Figure 14 we show an extra a-c anode voltage w,(r), 


Fig. 14. Applleatlon of external excitations to an osclilator. 
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an extra grid voltage u,(r) and an extra voltage 1,(t) across the in- 
ductive branch of the LC-circuil, where ,(r) can be introduced by 
coupling L with another coil. To avoid repetition of calculations which 
clasely resemble ane another, we assume that all three extcrial voltages 
are present simultaneously; afterwards any voliage which fs nol actu- 
ally present can be set equal to zero tn the final equation. Tquating the 
voltages across the two branches of the LC-circuii, we find that 


LI + RE Wy) 2 |G Da 


Since the grid voltage is now M/ +u,, the equation describing the oper- 
ation of the oscillator (in the absence of shat noise) becomes 


14m gl=oo[—RCI+F(MI—DLI- DRI +u,+Du,+Du,)+Cw]. 
(4.13) 


For a tank circuit with high Q, we can neglicct the term &/ compared 
to LI~ Lw,/. Then, setting 


u=H,+ Du, + Duy, (4.14) 


we write (4.13) in the form 
Feotl=oi{-RCI+F[M 1 +u(n] + Om}, (4.15) 


where M’=M~—DLcan be replaced by M if the reaction of the anode 
load is negligible. The external excitations may be regular or fluctu- 
ational in nature. For example, if 


ue=u,=0, u,= U, cosas, (4.16) 


& 


then, taking account of shot noise and neglecting the rcaction of the 
anode laad (D=0), we have 


P+ wel = we[— RCL + F(MI)— @,CU sina, +1, (t)]. (4.17) 


To make (4.11), (4.15) and (4.17) resemble (4.3) completely, we need 
only introduce a small paramcter ¢. Before doing this, we have to get 
rid of the dc component /_ of the anode current, which can sometimes 
be quite large. This can be achieved either by subtracting out /. or by 
differentiating both sides of the relevant equation with respect to time. 
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The latter ts the appropriate procedure when J. varies appreciably 
over several periods even though it is substantially constant during a 
single period, and after carrying out the differentiation, it is convenient 
to write the resulting equation in terms of the grid voltage U,= MIU, 
However, if J_ does not change appreciably even over a large number 
of periods, it is best to write our equations in terms of J—/., the a< 
component of the current in the inductive branch of the LC-circuit, or, 
what amounts to the same thing, in terms of the quantity 


x=@,>MCU—-J.) (4.18) 


with the dimensions of voltage. For pure sinusoidal oscillations, this 
voltage has the same amplitude as the a—c voltage on the grid of the 
tube. Let F,(U) be the tube characteristic after the d-c component of 
the anode current has been subtracted out, Le., 


i, -Ie = Fo(U), where U=U,+4DU,. (4.19) 


Then, for example, using (4,18) and (4.19), we can write (4.12) in the 
form 
X + wax = wo [9M Fy(X/wo) — RCX + woMI,(t)]. (4.20) 


In exactly the same way, equation (4.15) corresponding to the presence 
of an external excitation ,(r) [with u,=0, D=0] becomes 


¥ + Wox = We [WoM Fo(X/W9) — RCX + oMCu,(N)]. (4.21) 


It is often convenient to approximate the tube characteristic by a 
cubical parabola 
Y 
F(U)= _ + Fy(U) a1. + SU FEU? 20, (4.22) 
where S is the “‘steepness” (transconductance) and > is a parameter 
sometimes written in the form S/V*. If the characteristic is symmetric 
with respect to the operating point, we can use the simpler expression 


F(U)=SU— 20". (4.23) 


Which of the approximations (4.22) and (4.23) should be used is only a 
detail affecting the final calculations. The simpler expression (4.23) can 
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Sometimes be used even when the characteristic (4.22) is asyinmetric, 
Since it turns out that the term fu?/2 has no effect in the first approxi- 
mation [see the discussion of equations (6.6) and (6.7)]. Using (4.23), 
we can write (4.20) and (4.21) in the form 

4x? , 

ara) + wed (1). (4.24) 


7 2 

X + WoxX = tW,[ 1 — > 
( 305A5 

Here we have introduced the following notalion: ¢=«,(AfS— RC)isa 


Small parameter, the quantity 


A (ey 2( : y (4.25 
: My Nay My ae 


as will be apparent later, can be interpreted as the amplitude of the 

oscillations of grid voltage [cf. (4.41)], and &(r) is arandom function 

equal to i 
WMI MMC 

E(Q=—--£ or E()= os . (4.26) 


g 
depending on whether we are talking about the case of internal shot 
noise or the case of an externally applicd random excilation 1,. 

* The fluctuational term e€(r) in equation (4.24) can also be wrilten 
in other ways by choosing one of the following expressions 


fo (t), alee (t), ee, (t), elc, 

The choice of a particular way of wriling this term is to a cer(ain 
extent determined by the intensity of the fluctuations (for larger 
fluctuations, a smaller power of ¢ is preferable). bert is still rather 
arbitrary. In fact, nothing prevents us from regirding the fluctuations 
as either small or large, regardless of our choice of the cxpressijon 
e'E,(r). For an actual self-excited system, the question of which version 
of the Auctuational term to choose is not particularly important, since 
the basic behavior of the results obtained always turns out to be the 
same. However, as will be apparent later, the form «''*Z,,, has one 
advantage over all the others, i.e., it is the only form such that the 
fluctuational scatter of the amplitude remains finite as c is made to 
approach zero in the equation 


4x? ie, 
pe te Pug€(s). (4.27) 


i + abx = e091 ~ 302 42 
Q/ta 
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while holding the other parameters, including ¢(r), constant. More- 
over, despite the fact that the form &(r) does not explicitly exhibit the 
smallness of the fluctuations, it does allow us to avoid the somewhat 
artificial! procedure of dividing true fluctuations (e¢.g., @gAfI;) by e 
and then multiplying the result by the same power of ¢ when substi- 
tuting €, into the equation governing the osciflations.* 

Next we give Soine typica! numerical values of the paramelers 
figuring in equation (4.24). Suppose the capacitance, inductance, 
resistance and mutual inductance in the circuit shown in Figures [2 
and 13 have the following values: 

C=135 micromicrofarads, L=1.6 millihenry, 
R=1 ohm, M<0./8 millihenry. 
Then the resonant frequency is 


Wo = sas 7 x 107 sec” *. 
JLC 
Moreover, suppose we use the Russian tube type [ —837, which has 
the following d-c operating voltages (u,; = 12 v): 
,=—10v, EF, =4000, Excreen = 2000. 
The characteristic of this tube is represented by the solid curve 42 in 
Figure 15, and the dashed curve CD shows the approximation (4.22) 


-20y -15 -10 -5 O Ur 
Fig. 15. Actual and approximate grid characteristic of the /-837 tube. 
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corresponding to the numerical values 
S=6ma/jv, B=0.18ma/e?, y = O0.06nta/r’. (4.28) 
Then, according to (4,25), we have? 
£20.06, A, 190d. 


Thus we see that the inequality 
e<l, 


underlying the theory of self-excited systems which are approximately 
conservative harmonic oscillators (so-called systems of the Thumson 
type), is well satisfied. The actual experimental value of the amplitude 
Ag turns Out to be 11 volts instead of 19 volts, which is explained by 
the fact that the latter value ltes 1n the region where our approximation 
breaks down (i.e., where the curves AB and CD diverge in Figure (5). 
A more exact analysis requires the use of a better approximation for 
large U, 

Equation (4.24) without the fluctuational term woet(t) has been 
studied in detail in the theory of nonlinear osciflations. Naturally, the 
presence of the random funclion &(r) introduces certain distinctive 
features, compelling us to supplement the ordinary theory of non- 
linear oscillations by introducing probabilistic considerations. {n the 
next two sections, we use the example of equation (4.24) to illustiale 
the statistical methods of investigating self-excited oscillations in the 
presence of noise which wili be applied later on. 


3. Equations in Standard Form and the Simplified Equations 


In studying self-excited oscillations, it 1s convenient to go over from 
a single second-order equation to two first-order equations which 
describe the behavior of the amplitude and the phase. As functions of 
time, the amplitude and phase contain components that are large but 
slowly varying, in addition to components that are rapidly varying but 


2 In other circuits, one oflen encounters smaller values of the steepness S, and 
correspondingly smaller values of the parameter c. 
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small. Therefore it can be expected that the time derivatives of the 
amplitude and phase appearing in the indicated equations will be small. 

The concepts of amplitude and phase are intuitively clear, but in 
trying to define these concepts precisely for oscillations which are not 
harmonic (although almost so), we encounter a certain arbitrariness 
that becomes smaller the closer the given oscilJations are to being 
harmonic (cf. Chap. I.7). As the definition uniquely determining the 
amplitude and phase of the oscillations described by equation (4.3), we 
Choose = A C05 (Wet +), Fe —WeAsin(wot +e), (4.29) 
where @ is the angular frequency figuring in the teft-hand side of 
(4.3). Differentiating the equations 


~2\ Lf2 « 

be 1.0 x 

A =(x +4) , p=—arc tan— — wo, (4.30) 
Wo Mox 

which give the amplitude and phase explicitly, we find that 


x x 
Az=-~(¥+w gx), ¢@=—-—>(k + 2x), 4,31 
a. ox), @ mae ee (4.31) 
or, using (4.3), 


. é ear ; t é 
AS ag Ursa PPE Aae Cee (4.32) 
We must still express the right-hand sides of the equations (4.32) in 
terms of A and ». Using (4.29), we find that 
A=eG(A,9,1), @=&H(4,9,¢), (4.33) 


where, for brevity, we introduce the notation 
1 
G(A,¢,1) =-— f(A cos %, — w,A sin @,¢) sin @, 
Wo 


(4.34) 
H(A,@,) =- P “5 (A cos ®, — WA sin 9, f) cos @ 
0 


(@ denotes the quantity wot+ %). Following Bogoliubov and Mitro- 
polsky,? we refer to the system (4.33) as the equations in standard form 


3 See N. N. Bogoliubov and Y. A. Mitropolsky, Asymptotic Methods in the Theory 
of Non-Linear Oscillations (translated from the Russian), Gordon and Breach 
Science Publishers, New York (1961). 
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(cf. p. 1.186). It should be noted that the derivatives in (4.33) are 
proportional to the small parameter ec. In general, the functions G and 
H contain a random excitation €(t). 

Next we find the concrete form of the system (4.33) when the oscil- 
lations are described by equation (4.24). According to (4.32), we must 
multiply the right-hand side of (4.24) first by x/wgA and then by 
—x/w,A. This gives 


& . 4x4 E 
A= ‘(#-sa + Xs, 
WA 309 AG A 


. 3 ( 4x? . €% . 
= -: = aos dK - Se. 
. 36 Ae az? 


(4.35) 


Substituting the expressions (4.29) into (4.35), and gotng from products 
and powers of trigonometric functions to functions of multiple angles, 

we find that 
fw A’ 
4a als —cos2@- -; 
2 A 


0 


Pcl? ees 10) Esin’, (4.36) 
—, cv --5¢ — cyé sin &, ; 
342 342° Cae, 

seo 24? A? a 
p=" 1-74, )sin2@ +, sine mee eee 

2 342 3A2 A 


Along with certain advantages, the equations in standard form have 
one drawback, associated with the fact that the functions G and H 
depend not only on A(‘), e(t) and €(t), but also explicitly on time 
through various trigonometric functions of wot. These functions pro- 
duce rapid oscillations, and hence will be referred to as “oscillatory.” 
For example, in the first of the equations (4.36), the term 


A cOS2P=A COS (2Wof +29) =A cos 2Wof cos 2——A sin 2eat sin 2g 
(4.37) 


contains the double-frequency oscillatory fonctions cos 2w ft and 
sin 2wof, in addition to slowly varying functions of 4 dnl g, Our 
problem is to eliminate the oscillatory functions, thercby obtaining 
equations which do not contain rapid oscillations. For brevity, the 
resulting equations will be called the ‘‘simplified” equations. 
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As can be seen from (4.36), rapid oscillations figure not only in 
regular terms of the type (4.37), but also in the fluctuational terms 


— eg£(t) sin (wot +), — ee E(t) cos (wot +@). (4.38) 


Correspondingly, the problem of eliminating oscillatory functions can 
be divided into two stages, which can be carried out in either order. 
Suppose we begin by eliminating oscillations from the nonfluctu- 
ational terms. These terms can be isolated by averaging the equations 
(4.34). Thus we examine the auxiliary equations 


A= eG) =6G,,(A,@), @= CH) =&H,,(A,¢), (4.39) 
which in the particular case under consideration take the form 


. EW A? {4A? A? 
=-—A]/Il—-—, +[-.,—1] cos 26 — —_, cos 44 |, 
2 Ag \3Aq 3AG 


Bo (28 Vane. aang 
= — -—, |sin -> sin ; 
o™ 9 342) 342 


Consider the problem of eliminating the oscillatory functions from 
(4.40). To a first approximation, this can be achieved by simply time- 
averaging over a period, under the assumption that the amplitude and 
phase do not change. As a result of applying this familiar method, the 
equations (4.40) reduce to 


. EW, ‘,) 
Ge i Baek: 441 
5 ( A 9 ( ) 


(4.40) 


These equations, which involve only nonoscillatory terms, will be 
called the “truncated” equations. 

If greater accuracy 18 required, we must resort to other systematic 
methods. To higher approximations, corresponding to any desired 
accuracy, we can obtain nonoscillatory equations by the use of the 
asymptotic methods developed by Bogoliubov. Here we give a special 
version of this method, the gist of which consists in introducing the 
transformation of variables 


A=A*+eu(A*,O*), @=O* +4 e0(A*, 6"), (4.42) 
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h 

bie ©* = wot +o. 
This corresponds to transforming to a new amplitude A* and phase 
g*, defined somewhat differently than before | see (4.29) and (4.30) ]. 
The functions u(A*, ®*) and v(A*, *) appearing in the defining 
equations (4.42) are chosen in such a way that the equations for the 
new amplitude and phase, which are equivalent to (4.39). contain no 
oscillatory terms. 

The functions u* and v* are not found exactly. but rather by suc- 
cessive approximations, i.e., by step-by-step determinittion of the 
terms of the expansions 

u(A*, ®*) =u, (A*,®*) + eu, (A*, 0") 4 
v(A*,®*) = v,(A*, &*) + ev, (A*, 9") +... 
At the same time, we find the terms of the nonoscillatory equations 
A* = eGi,(A*, 9") = eGi + &°G? + 
g* =cH3,(A*,o%) = cH +e ny t+... 
This is done as follows: Substituting (4.42) into (4.39), we find that 
A* + en = &G,,(A* + cu,” + er). 


(4.43) 


(4.44) 


4 
g* + eb =6cH,,(A* + cu, g* + ev). 8) 
Bearing in mind that 
Ou Au , 
“= aa* At‘ + 50" (wo + g*), 
dv 
Se nee Ate 
ey + jgelino +99, 
and substituting (4.44) into (4.45), we obtain the equations 
G* Ou Cu * cu HH 
fo + Wo 53 = GalA® + Ett," +00) 256% ae ap? 
(4.46) 
He dv Cv is * 
o + @oa = H,,(A* + eu, * +60) — 875, Gh — ccc 


which Serve to define the functions u, v, G* and 7*. In fact, replacing 
these functions in (4.46) by their series expansions (4.43) and (4.44) 
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with respect to £, and equating terms with identical powers of «, we 
find the equations governing the successive approximations, i.e., 


Cu, 
Gt + Wo se = G,,(A*,@* ); 


(4.47) 
+ dv, * + 
Hy, + 0 38 av {A’,@-) 

in the first approximation, and 
Gt Ou, 6G, 6G,. 7 Ou, Ouy 
2 Moca aa “tt apy. t rs a Prue 
H} sg OO gy oa - OP Ge Ot ays a 
ag* 0A} tg tS COaa* + apt 


in the second approximation. Each of these equations separates into 
two parts, ie., oscillatory terms involving du/d@* and du/d@*, and 
nonoscillatory terms involving G* and H*. Together, (4.40) and (4.47) 


imply 2 
Gi (A, @) = = a(1 = a) Hy (A,g) =0 (4.49) 
0 
and 
du,(A,®) A 44? A? 
ous ( De —— 7 cos 2@ — --.. cos 4@], 
0g =), 3AG 3AG 4.50 
dv,(A,®) 1 2A7\ . 7 aan ee) 
— .——*=+[1— =, ]} sin 2@ + —s; sin 4@. 
ag 2 3A5 6AG 


It follows that 
AT. (4A? A’ 
uy (A, ®) = 52653 =] sin 2@ — —,; sin +0, 
8 AZ 3A2 


@ ; 21 2A" 20 At 4h 
et ae — Cc co . 
1 (A, ?) 8 3A2 < TE : 


We see at once from (4.49) that the first approximation actually 
gives the same result as the simple average (4.41). To obtain the second 
approximation, we have to use (4.48). The functions G3 and H¥ are 
affected only by the nonoscillatory terms which are not contained in 
the terms of the form 


(4.51) 


Cu 
aA* 


* 
Ls 
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Le., 


: ; _ 0G,,. CG oy 
> = the nonoscillatory lerms in -- t+ > ry, 
cA Cy 
7 ; _ OH, OH,,. 
Hy = the nonoscillatory terms mm -——1t, + - Ss 
cp 


Taking account of the form of the functions G,,, H,,, v, and v,, we 
find that 


w A* AA 
+ =0, H* A, osha 2-—4 7 3---)}, 4.52 


Thus, together, (4.42), (4.43) and (4.51) transform the equations 
(4.40) into the nonoscillatory equations 


Eu) Aw’ 
At = (i = a) A* + O(e"), 
0 


2 *2 #4 
sig E Wy A A 3 
= 2~—4 3 Oo : 
i 16 ( A? as aye (") 


By using (4.42), the generated signal x= A cos (yf+q) can easily be 
expressed in terms of the nonoscillatory amplitude and phase. Retain- 
ing only the first correction, we have 


(4.53) 


x = A* cos &* + eu, (A*, 6*) cos 6* — c€A*v, (A*, b*) sin @*, (4.54) 


and hence, according to (4.51),4 


x * Es A‘? : * c A™* : ¥ 
x= A’ cos® +74 ae 1j}sin @° + Tarr sin 3". = (4.55) 
0 0 


4 It follows from (4.55) that the amplitude and phase A* and #* do uot coincide 
with the amplitude and phase of the Kryfov-Bogollithov method tn the narraw 
sense, since the latter correspond to the absence of correctlons to the furndamenrat 
frequency. As is well known, there is a certain arbitrariness in the choice of the 
nonoselllatory amplitude and phase, which leads to different nonoscillatory 
equations. Thus, the equations (4.53) can be transformed into the equations of the 
Krylov-Bogotiubov method by making another change of viniables and ieplacing 
A*, g* by Axa, @Kn. According to (4.55), the amplitudes 4* and Ax» coincide in 
the first appreximation, but, in the same approximation, the phases dilfec by the 


quantity ‘ AM? 
— g* = = 
exe — oe = (1-7) 
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We now return to the complete equations (4.33) and (4.35). The 
transformation of variables (4.42) and (4.51) eliminates oscillations 
from the nonfluctuational terms, and carries the equations (4.36) into 


: EW Att 
A*= (: _ =r 4" — EWoé sin 6* 
Ap 
Ou du, cos * 
6? ~v, cos o* + -— sin o* +- | —— |, 

* one aa* +30" ae 


16 Aa” AG 
E°W cos ®* av, dv, cos ® 
+ v, sin ®* + => = sin &* +—. 
A* fo " ey a ae a | 
(4.56) 


[cf. (4.53)], containing oscillations only in the terms involving the 
random function €(t). Although the terms in brackets are formally of 
order e”, it will be seen below that in practice their effect is of the 
third or fourth order, if the correlation time is not too large. This is 
explained by the fact that “fluctuational impacts” acting in opposite 
directions partially compensate each other, thereby diminishing the 
effect of the fluctuations. Therefore a corresponding modification of 
our formal scheme for constructing approximations js desirable, in 
which the equations for the second approximation with simplified non- 
fluctuational parts become 


oe #2 
A* -F(1 - aye — ew y& sin &*, 


: Ag (4.57) 
ew Av? A*4 oii . 
-* 0 0 * 
=— 2-4->—-+3—]-——_écos®’. 
4 16 ( A 7 “| ae 


For notational simplicity, we shall henceforth omit the asterisk in- 
dicating the nonfluctuational amplitude and phase, writing (4.57) in 


CMON. AesG AG. G2 Le, (4.58) 


where eG* and eH* denote the right-hand sides of (4.57). We can 
even drop the asterisks in the functions G* and H*, since this will 
Cause no confusion. 
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4. Simplification of the Fluctuational Terms 


Further simplification of the equations describing the behavior of 
the amplitude and phase wil] be based on the assumption that the 
correlation time t,,, of the random function ¢(r) is comparatively 
small. Here we do not compare 1,,, with the period of the oscillations, 
but rather with the relaxalion time of the amplitude (equal to I/etw in 
order of magnitude), imposing the requirement that 


To. oes (4.59) 
EM 

This means that the noise acting on the oscillator has a inuch greater 
bandwidth than the generated signal, a condition which is often satis- 
fied in practice (the opposite case will be considered in Chap. 8). The 
condition (4.59) is perfectly natural from the standpoint of the small- 
parameter method, since it certainly holds for sufliciently small e«, 
provided that the rate of the fluctuations is independent of «. 

If the inequality (4.59) holds, we can apply stochastic methods to the 
present problem, by regarding the evolution of the amplitude in time 
as a process without aftereffect. According to Chap. 1.4, Secs. 8 and 9, 
starting from (4.58), we can construct a generalized Fokker-Planck 
equation, involving a series whose terms fall off essentially like powers 
of the quantity ewot,,, <1 (cf. p. 1.99). In the diffusion approximation, 
where only terms of orders ¢ and e” are retained, it follows from (4.58) 


and (1.4.194) that 
w(A,@) : 
|e) 
“Horsf 2 fefeea})4 
ee {| K[G, G,]drw} + 
aA? 


= 2 
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+e a {| (K(G,H.] + K[H, Gar} 


E 
GA ee 


0 


a? 
fe* | | K[H, H,] dz v} ; (4.60) 


—@ 


where eG=eG* and eH=eH* denote the right-hand sides of (4.58). 
Here, in calculating averages and correlation functions, the amplitude 
A and phase ¢ figuring in G and H are regarded as fixed quantities and 
not as random yariables. Thus, in calculating a correlation function 


K[P,Q] = (PQ) — <P) <Q), 


we need only take account of the Aluctuational parts of the expressions 
G* and H*, i.e., the terms —ew,ésin® and ew A ‘Ecos@ in the case 
of (4.57). 

Because of the presence of oscillatory functions in the fluctuational 
terms, the right-hand side of equation (4.60) contains oscillatory terms 
of frequency 2w, in addition to smoothly varying terms. Since we are 
interested in the smooth changes of amplitude and phase, and not in 
the high-frequency oscillations, this suggests getting rid of the oscil- 
latory terms by performing some kind of an average over a period. 
In fact, it turns out that such a simplification js permissible, subject to 
the following reservation: An oscillatory term of order € not only 
describes oscillations of the probability density of order ¢, but also 
produces smooth varjations of the probability density of order e’. 
Similarly, the oscillatory terms which figure in the terms involving 
integrals in (4.60), being of order e*, produce smooth variations of a 
still higher order, and hence can be neglected, since equation (4.60) 
itself is accurate only to the second order. Thus oscillatory terms of the 
second order can be dropped. The first-order oscillatory terms in <G) 
and <H) would lead to considerable complications, if they had not 
been previously eliminated, since we would then have to take into 
account their effect on the smooth varjations of the probability density 
in the second order. However, it was just to avoid this difficulty that 
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we insisted upon preliminary elimination of oscillations from the non- 
fluctuational part of G and H, as described in the preceding section. 

Moreover, it is easily seen from (4.60) that a Aluctuational term of 
order ¢ (containing e¢) actually affects the probability density to order 
e*. But the diffusion equation (4.60) itself is accuratc only to order e?. 
In particular, this justifies our previous neglect of terms of the type 
—e?w,¢év,cos® in (4.56). As far as equation (4.60) is concerned, the 
retained terins —ewoésm® and —ew A 'Ecos@ are cllectively of 
order ¢?, and since this order is the same as the maximum accuracy of 
(4.60), it makes no sense to look for a third approximation, by using 
the procedure described on pp. 100-103. 

* The situation is different if the random excitation is taken to be of 
the form e€, (see p. 95). Then the effective order of the fluctuational 
terms is 2r, and we must first eliminate oscillations from (G) and ¢H) 
of orders ¢ to e”" inclusive, by constructing successive approximations 
and redefining the amplitude and phase, i.e., at least 27 successive 
approximations must be made. However, as before, il is pointless to 
go to an approximation of order higher than 2r. 

In particular, if the Auctuations are chosen to have the form !/7€, 9, 
then it is sufficient to calculate G{ and A, and all terms in the equa- 
tions in standard form will be effectively of the first order, just as in the 
Fokker-Planck equation. If r=1, as assumed previously, tt is sufficient 
to go to the first and second approximations (4.47) and (4.48), and the 
Fokker-Planck equation is accurale to terms of order 7. If the form 
e*&, is chosen, we must also calculate the functions 1, r, and wy, v3. 
Then these functions are used to define a new amplitude and phase, for 
which we write equations involving Gi, H{, ..., Gy, 114, accurate up 
to terms of order c*.% 

Having made these general observations, we return Lo the specific 
case of equation (4.57), where it only remains Lo eliminale oscillations 
due to fluctuations from the integrals appearing in (4.60). Consider one 
such integral 


Q 


| K[G,G,]dt. 


—@ 
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Replacing eG by its random component —éwpé sin ®, we obtain 


Q Q 
| K[G,G,] dr = 05 i <éE,) sin @ sin @, dr. 


Using the identity 


sin @ sin #, 
= $cos(, — 6) — $cos 26 cos ($, — &) + 4 sin 26 sm (6,-4), 


we can transform this equation into 


Q ta) 
2 
| K[G, G,Jdt = mae — cos 26) | CEE.) COS Wot det 


. 0 
Wo. : 
+ > sin 28 i CEE SIN Wot dt. 
In the case of a stationary random process €(f), the quantity <&é,> 
depends only on t, and the integrals on the right are equal to constants. 
Therefore the rate of change of the whole expression in time is de- 
termined by the trigonometric factors. Separating out the smoothly 
varying part, we have 
0 0 
09 
| K[G,G,] dt = = | CEE COS Wot dt + oscillatory terms. 
= — 0 
Thus in (4.60) we can make the substitution 
0 
2 
Wo 
| K([G, G,| dt 7 K (Wp), (4.61 


where 


2k (Wp) = 2 i CEE.) COS Wot dt = S[E; wo] 


—-@® 


is the spectral density of the noise €(#) at the frequency w,. Two of the 
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other integrals can be written in the form 


0 0 
2 
| (K[G, H.] + K[H,G,]) dt = 2 | CEE sin (@ + Halt 


Q Q 


Wo Wo 
=. sin2@ 4 CEE, cos Wot dt + | cos 2@ 
—-@ 


CEE, Sin Wot dt, 
I 4 


—- wv 


(4.62) 


and contain purely oscillatory terms. The last integral in the right- 
hand side of (4.60) is 
0 


0 
wg 
K(H,H,| dt = rr CEES cos Bcos Gat, 
-@ — a 
and can‘ be written in the form 

0 


| K [H, H,| dt = i K{Wo) + oscillatory terms, (4.63) 
—@® 
by analogy with (4.61). 

The integrals in (4.60) involving derivalives can be handled in just 
the same way. The first of these integrals disappears xl once because 
the fluctuational part of G is independent of A. Of the remaining 
integrals, which have the form 


0 0 
aG wi, 

K| —.H,|dt=--- | (&E> cos @cos G, de, 
dg A 


un 2) 


Q - J 
| 1K <,| ‘ KS H,|} Fhe CEE sin (® 4 Jade, 
GA de ‘ 


« 
—-@w = 


only one has a nonoscillatory part: 


0 
dG Wy : 
K| —,H,|dt = —-K(wo) + oscillatory terns. (4.64) 
de 4A 


—-@ 
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Thus, finally, after using (4.61)-(4.64) to eliminate oscillations from 
the fluctuational terms, the Fokker-Planck equation (4.60) becomes 


oe eW9 a A 
b= Fle +3 «(ws) |} — tec > w) 
2,2 2 a? 
r “2 ecan(2 ba w (4.65) 


Equation (4.65) is equivalent to the following ‘‘completely simpli- 
fied” equations 


Pe EWp A? A gw 4.66 
= (1 — a + — + EWoN (1), ( . ) 
‘ & Wo A’ 


where 4(£) and {(1) are ately Pam mutually independent 
Gaussian random functions, with zero mean and correlation function 


Cn) = cit = MOO, 7): (4.68) 


In fact, if we construct the Fokker-Planck equation for the system 
(4.66) and (4.67), using the general prescription (4.60), we obtain 
precisely the equation (4.66). 

Of course, the simplification of the Aluctuational terms which leads 
from (4.57) to (4.66) and (4.67) can also be accomplished in other ways. 
One such way is to consider the analogues of the equations (4.57) in 
rectangular coordinates 4 cos ~ and A sin gm. Then Aand are polar 
coordinates and the fluctuational terms have a simpler form, inde- 
pendent of the coordinates. We now sketch this alternative approach, 
which, despite its lack of rigor, is closely related to the method used 
previously, and to a certain extent gives an intuitive interpretation of 
some of the terms appearing in equation (4.60). 

Thus suppose we write 

ni () =— E(t) sin [wot + (0), 
C(t) =— €(t) cos [wor + —(t)] 
in (4.57). Here the phase @(r) is correlated with the values of the ran- 
dom function &(1), a fact which greatly complicates the calculation of 


(4.69) 
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the mean values and correlation functions of », (4) and 2, (4). However, 
we Shall assume that the correlation time of the process ¢(£) is so small 
(cf. (4.49)] that a time shift 4 can be found which simultaneously 
satisfies the relations 


4 > Teor 
|A() — A(t— 4)] =|A— A_4| €A0, 
le(t)—e(t—A4)| =|o-— @_,| <1. (4.70) 


This means that although 4 greatly exceeds the correlation time, the 
amplitude and phase do not manage to change apprecially during the 
time 4. Since the values A(f—4)=A_, and g(t—A)=¢@ -, are close 
to A(t) and ¢(2), it is a good approximation to write (4.69) as 


Wy S— E Sin (Wolf + P_4) ~— Ecos (pt + G_4)AQ, 


C1 B— C COS (Wol + P_4) +6 sin (Wot + P_ «Ae, oa) 


where 49 = p~— p_,. However, A_, and g_,, unlike .1(¢) and (2), 
are effectively statistically independent of €(t), and hence we can 
average over € and @_, separately. This gives the following expressions 
for the mean value of (4.71): 


<np> = — cos(@ot + —)<EAQ), 


; 4.72 
(C1) = — sin (Wot + o) <EAq@)>. ( ) 
Next we integrate the equation for the phase, oblaining 
t 0 
soe | Hdt=e [ Hea, 
t= 4 ~4 
which implies 0 
<EAQ) = — Eo | (cf COS (Wot + Wat + oa) dt, (4.73) 
-d 


where we have used the form of the fluctuational part of the function 
H. Once again exploiting the fact that A, and ¢, differ only slightly 
from the values A,_, and @,_,, which are effectively independent of 
€, and &, we transform (4.73) into 


EWo { 
<éAg)> =— ri | CEE.) COS (of + Wot + —)dt. (4.74) 


-@ 
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Here we have extended the lower fimit of integration lo — 00, since 
the correlation function in the integrand is essentially zero for 
|t|> 4>,,,- 
Substituting (4.74) into the first of the equations (4.72), we find that 
) 


ew 
(1p = 7 | CEE.) COS (Wot + Y) COS (Wolf + Wot + y) dt 
—~ 2 
xe) 
= i K(@o) + oscillatory terms. (4.75) 
Apart from a constant factor, (4.75) coincides with the expression 
(4.64), which leads to the term 


in (4.65) and (4.66). Thus the appearance of this term in (4.66) is due to 
the fact that the correlation between €(s) and @(r) causes the fluctu- 
ational! terin ewoy, to have a nonzero average. Similarly, substituting 
(4.74) into the second of the equations (4.72), we can easily verify that 
the mean value <C;> contains only oscillatory components, which 
vanish when averaged over a period. 

We now find the correlation functions of the zero-mean processes 
n=n,—<n,> and €={¢,. Since in each of the equations (4.71), the 
presence of the second term on the night affects only the mean vatues, 
we can write 


; EWo : 
y=— sin ® —-— K(wWo) = — €sin (wot + G-,), 
4A 
(4.76) 
C=- Ecos P= — Ecos (wot + p_ 4). 

Since the correlation lime is much smaffer than the relaxation lime, the 
random excitations act as if they were uncorrelated, and the actual 
correlation function can be replaced by one shaped Jike a delta function: 


<nn,) > 5(c) i Cn) dt. (4.77) 


—@® 


Here we choose the intensity coefficient to be f¢yn,>dt, since then 
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integration of both sides of (4.77) with respect to r gives the same 
result. Taking account of (4.76), we find that 


| «nn, dt = | CEE SIN (Wot ze P) SIN (Wot + Wot + dt 


@© 
= ; | CEE COS (Mot + Y, — P)dr + oscillatory terms 
-o 
K 
fs ee + oscillatory terms (4.78) 


(since |g, — @| <1 for t~7,,,), and similarly for ¢. It follows at once 
from (4.77), (4.78) and (4.68) that, as far as their nonoscillalory 
behavior is concerned, the functions (4.76) coincide with the corre- 
sponding functions figuring in (4.66) and (4.67). This justifies the 
transition from (4.57) to the simplified equations (4.66) ind (4.67). 
Finally, we note that it is convenient to introduce the dimensionless 


parameter 
c= — —-— (4.79) 


characterizing the intensity of the Auctuational excitations. [n fact, 
going over to a dimensionless amplitude a=4/A,, we can write the 
equations (4.66) and (4.67) in the simplified form 


Be 3, € iy 

—~—d@=a-at+- +2--. 

EWo 2a Ag (4.80) 
ya E ; Pree 4 
-~g=—-(2—4a° +30") +- : 

&Wo 8 a Ay 


Supplement 


* For completeness, we now describe a general method of elimi- 
nating oscillatory terms directly from the stochastic equation. Suppose 
the latter is of the form 


Ww =eL(t,e)w=eL, (hw te7Li()wt..., (4.81) 
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where w’=1(z), and L(z, e) isa linear operator (the method can also be 
generalized to the case of nonlinear operators). Let the time dependence 
of L{r,2) be due solely to the presence of oscillations, say, to de- 
pendence on the functions sinkwof and coskwot. For example, equa- 
tion (4.60) is of the form (4.81), with w(z)=w(A, @). Suppose it is 
required to replace (4.81) by an equivalent nonoscillatory equation 


i* = aL y*, (4.82) 


writlen in terms of some other function w*. Then we use the following 
method, generalizing that described on pp. 100-103. The gist of the 
method is to make the transformation 


w=w* +eF[w*] =w* + eF,[w*] + e?F,[w*] +..., (4.83) 


where F*{[w]=F{w’, z, t,e] and the F,[w*, z, ¢] are functionals of 
w*, whose dependence on ¢ [s oscillatory. Differentiating (4.83) with 
respect to time and taking account of (4.82), we have 


OF , OF 
waoel*w* +e— +e? 74 
ar ar 
4.84) 
5F, SF ( 
Dw" dz ‘ 2 el*w* ae One 
re] eta w dz+e linet w dz+ 


The operator L* and the transformation (4.82) will be approximated in 
stages, by successively calculating the terms Lf in the expansion 


el Hel, tel (4.85) 


and the functionals F,, F,, ... Substituting (4.85) into (4.84), and using 
(4.81) and (4.83), we obtain the equation 


; OF OF 
el’ w* Pe od Oe + wee +e ob aa . 
=eL(t,e)w* + e7*L(te)F, +eL(t,e)F, +... 


OF 
- ay (elt et a) we dz oo) 
Ww 


OF ¥ 
-2 | Seer +e +...wdz—..., 
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which can be used to generate the desired successive approximations. 
Equaling terms in (4.86) of the same order in e, we find that 


OF 
iw + ae =L, (t)w* , 


OF OF 7 
Law + a = L2(t)w" + Ly (QF, se Liw" dz, 


The nonoscillatory terms in the right-hand sides belong to Lj 1*, while 
the oscillatory terms belong to dF,/dr,. Therefore 

[\\w* = nonoscillatory terms in L, (t)w*, 

OF; : , * 

ao oscillatory terms in L, (t)w", 


a) A : * “OF x oe 
Dw" = nonoscillatory terms in L,(r)w" + L£,(t)P,—| . ,Liw'dz, 
ow 


GF; ee 
i = oscillatory terms in L(4)w* + L, (t) Fi -{) Liw* dz, 
3 


Using these relations, we can successively determine LT, F,, L3, Fa, ...» 
i.e, we can write equation (4.82) and the transformation (4.83) to any 
accuracy. 
We now give two examples illustraling the above method. 
Example 1. Suppose (4.81) is a first-order equalion of the form 


: EWo a A Aj re 44° A © A® Ad 
_— ae eer —; — cos — ——; COS Ww 
” 2 aA Ag \3AG 3AG 


&W, a 2A\ . As. 
(4.88) 


corresponding to (4.40) without fluctuations. In this case. the first two 
terms of (4.87) are 


Mo é A a 
rw = ial (4 —— )w |. 
2 dA As 
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OF, 427, é 443 Aj 
A eee eee —,; — A} cos 2¢ — —~ 4@ |w* 
at 2 al GS ) yaaa i 


Wg a 2A? e A? . » 
See 1 —~—,]sin2 + —, sin4@]w">. 
2 do 3Ao 3AQ 


It follows from the last equation that 


F ard 4A" A \sin2@ A 4 | y* 
are 5 = S = S 
; dA UL \342 me sas” 


4 

2 é ; 2A? 3 A? dale 
—_-— ——, ] cos —>+c : 
4 dp cy) aan 7 emai dl [i 


OF 
[See dAdo 


(4.89) 


Since 


contains no nonoscillatory terms, we find that the third of the equa- 
tions (4.87) takes the form 


L’,w* = nonoscillatory terms in Ly, (t) F,. 


We must now substitute from (4.88) and (4.89), and afterwards drop 
oscillatory terms. Obviously, the expression 


Taal)" 
Sa at Sa el 
2 3A Az 


contains only oscillatory terms. Moreover, terms of the type 
cos k@ sin I are oscillatory. Therefore L3w* equals the nonoscillatory 
terms in the following expression: 


2 (S = 4) cos 2@ — A005 40 
8 GA] \3A_ 3Ag 
a 2A? A? ‘ 
alc -34] cos 2@ + Zgcor so] 
Pea i(: 3a) sin 20 + BS a 10 
342 3AG 


: 4A A} sin 2@ A" in 4@ | y* 
x a4 342 $1n 6A $in W 
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WM @ 2A? A? 
ees aed 1 ~-—., } sin 26 + —— sin 4@ 
8 de 3A6 3Aq 


Fl 2A? A? 
x=-|[1——-—, }cos26 + —, cos46 |w". 
dp 342 6A2 


0 a 
sin k@ — = — sin k@ — k cosk@, 
dp do 


Using the formulas 


a) ff) 
cos k®— = — cosk@+ksink@, 
dp deo 


we move the operator 0/0 @ over to the left. Then, dropping a number 
of oscillatory terms, we have 


yt 2 a? [/4A° 24° A | 
2W =—— —3x—-Aj}l[ J) -—-—3)-=aI" 
16 dAde| \3AG 3A4/ 1845 


oo OT /, 2A7\ 6 (443 4 OA |. 
"6 do 342) 0A\3A2 342 a4 6A2 | 


+ nonoscillatory terms in 


Wo @ : 2A? Ss 1a. - 
—— _— — — ww —_-_ —. 
4 d@ Az ee Oh Big 


~ = 
2A” A’ 

x|[1=—_ 5 cos 2@ + —-., cos4@ we. 
3A6 6AG 


Using the relation 


a 9 
F(A), = 5,FA-S (A) 


to transform the middle term, and retaining only nonoscillalory ex- 
pressions in the last term, we finally obtain 


Wo @ A’ A* 
fw = < vol (2-443 +34,)u"]. 
Q Ao Ag 
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after doing a bit of algebra. In this approximation, the nonoscillatory 
equation (4.82) has the form 


w* = eLtw* + 27 Lowi, 


and corresponds exaclly to the equations (4.53) obtained previously for 
the nonoscillatory amplitude and phase. Thus the method of elimi- 
nating oscillations from the partial differentia! equation (4.88) is 
equivalent to the method of eliminating Oscillations directly from the 
ordinary differentia! equations (4.53), i.e., to the method described on 
pp. 100-103. 

Example 2. Next we consider the equation 


o? w2 in 2@ 
[feo sin 2¢ »| a pew bethnw; 


w= eLiw +e" 5 7 
(4.90) 
where L} is some nonoscillatory operator, and the fast terin is a typical! 
term Jike those which will appear in (4.60) if the fluctuational! terms in 
(4.47) are chosen in the form e’Ewosin®, e"Ew,cos ®. The term in (4.90) 
comes from the term (4.62) in equation (4.60). Applying (4.87) to this 
case, wesee that Lf = L?, while aff the functions Fi, L3, ..., F2,-,, L3, 
vanish. The first nontrivial equation in (4.87) corresponds re the index 
2r, and is of the form 


OF,, woK(w) 3° x 2@ | 
= w* |. 


a .46©6h2.~COA Ge COA 


which implies 
a? [cos 26 
Fo 6 CO) ee |. (4.91) 


We now lind the first nonzero nonosci{latory correction to the non- 
oscillatory equation 
w* = low" 


due to the function (4.91). With the help of (4.80), it is easy to see that 
the first nonzero correction e*’ Li,w* comes from the form e*’L2,(¢)F),, 
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and the corresponding equation (4.87) is of the form 


L',,w™ = nonoscillatory terms in L2,(t) 3, 
= nonoscillatory terms in 


we a? [sin2® a fcos2@ Vy 
—--K7*(w | -y" 
8  dAdp| A adAdg\ A 


= nonoscillatory terms in 


Oo » a> [2cos2 A fcos26 , 
-— K* (Wo) “oe —— 
8 @Ada| A  aA\ A 


Oo » a? 1 a fi" 
= --K* (W.)——_| - — | — } |]. 
8 GA dp| AGA\ A 


Therefore the oscillatory terms of order 7’ first affect the nonoscil- 
latory terms to the higher order e*’. All this is in keeping with whal was 
said on pp. 106-107, * 


CHAPTER 5 


Methods of Solving 
the Simplified Equations 


1. Amplitude Fluctuations as a Markov Process. 
The Fokker-Pianck Equation 


In this chapter, we give a brief summary of various methods of 
solving the simplified equations, deferring a more detailed treatment 
untiJ subsequent chapters. We begin by examining the method based on 
the use of the Fokker-Planck equation. The applicability of this 
method is restricted only by the condition that the correlation time 
be sinal] compared to the time constant characterizing the rate of 
change of the amplitude and phase. This condition, which takes the 
form (4.59) in the case considered above, allows us to regard the 
evolution of the amplitude and phase in time as a Markov process and 
the noise perturbations as a delta-correlated process [after making the 
substitution (4.77)], and guarantees that the probability densities of 
amplitude and phase obey the Fokker-Planck equation. The Fokker- 
Planck method is applicable for both large and smal! noise intensities, 
Perhaps the most characteristic feature of the method is that it can be 
used to find one-dimensional! stationary probability distributions and 
also to solve problems involving the reaching of boundaries, even in 
cases which are intrinsically nonlinear. However, the determination of 
correlation functions in the nonlinear case is a much more difficult 
problem. 

For example, consider the first of the equations (4.80), which takes 
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the form: 


; £Wg a c ia 5.1) 
= — aga@-—da - ? ry . 
2 ja) ( 


in terms of the random function 


with mean zero and correlation function 
2. EWg 
<n'n) = > 66 (t) 


[recall that c=«wgA5 7x (wo)]. As an intuitional aid, we shall think of 
the probability density w(a) as the distribution along the a-axis of a 
foreign substance introduced into a homogeneous medium, and, corre- 
spondingly, the evolution of the probability density in time will be 
regarded as diffusion of this substance. Then a realization of the 
random function a(t) describes the motion along the a-axis of a 
“representative point,”’ to be thought of as a kind of “inolecule” of 
the foreign substance, whose trajectories have a very complicated 
form. 

According to (5.1), the mean velocity of the represenlative point at a 
given position along the a-axis equals 


SSlasa 2 ) (5.2) 
2 2a 


Multiplying (5.2) by the density w(a) of representative points (“mole- 
cules’), we obtain a convection current of such poinls (a probability 


current) equal lo 
EWg qe 
—~-|a-a +_- Jw(a). 
2 ( x) (a) 


Moreover, the concentration has a nonzero gradient @w(a)/ea, which 
produces a diffusion current proportional to the concentration 
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gradient. As a result, the tota! probability current equals! 


EWo 5. © EWyc OW 
Gis\]—l4< oe re ee, 
(a) 5 (« a” + <) sai ake (5,3) 
Then, according to (5.3), the equation of continuity 
6G (a) 
J aera 68 


is just the Fokker-Planck equation (1.4.33): 


: 0 [ ewy Pee EW c Ow 5.5) 
Fal 20% Toa)" |* 4 oat e 


The one-dimensional Fokker-Planck equation (5.5) can be obtained 
by integrating both sides of the two-dimensional equation (4.65) with 
respect to ¢. 

Using (5.5) to find the time variation of w(a) is difficult when the 
probability is nonlinear, i.e, when the corresponding equation (5.2) 
for the random function a is nonlinear (as in the present case). How- 
ever, the stationary distribution of amplitude can easily be determined 
by using formula (1.4.49). Any initia] probability distribution varies in 


1 The coefficients of @w/aa in (5.3) and 4?w/@a" in (5.5) can be inferred by the 
following argument: For small values of ¢, the solution of the equation 


. 7] o?y 
Ss D _ 
w io (Bw) + dai 
(cf. (5.5)] is of the form 


r 
Ww eu a,f4Ds ; 


2VnDt 


if a, = 0 for f = 0. Therefore the “diffusion coefficient” D is given by 


which in the present case is just 


{ cnn, dt = = . 


p=! 
3 
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time as described by equation (5.5) and eventually approaches a 
definite stationary distribution which no longer varies with lime. Thus, 
setting w=0 in (5.5), we obtain the equation 


cd’w  d ea 28 

satisfied by the stationary distribution. Integraling (5.6). we find that 
c dw ae 
ada (<- a +) w = Const. (5.7) 


According to (5.7), the probability current (5.3) is the same theough al! 
cross sections, a condition which is obviously necessary if the proba- 
bility is not to accumulate anywhere. However, even more can be said 
in the present case. The representative poinis cannot systematically 
go off to infinity or arrive from infinity, since in practice the size of the 
amplitude is always bounded. Therefore the probability current 
vanishes for very large values of the amptilude, which means that 
the probability current vanishes for all other values of the amplitude: 


Integrating this equation, we find that 


a l 2 a* 2a ~fat—1)2:2 
=-— — —-—|]rp=—e " haat 5.8 
w (a) Nv exp ‘ {(< -)| nN" (5.8) 


where N is a constant determined by the normalization condition 


| w(a)da=1. 
Q 
Evaluation of this integral gives 
weJie [ Pa Ji ext ae 59) 
yr V2 4/20} 
ope 
Jie 


Figure 16 shows the form of the stalionary probabilily density w(a) 
for several yalues of the parameter c, which specifies the relative 
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O5 


05 1 15 A 


Fig. 16. Stationary amplitude distribution in the presence of broad-band noise. 


intensity of thefluctuational excitations. The probability density achieves 
its maximum value for 


anon =p t+ ST + Re. (5,10) 


Thus the weaker the noise, the closer the most probable value of the 
amplitude is to unily, i,e., to the stationary amplitude in the absence 
of noise. It is clear from the figure that as c decreases, the sharpness of 
the maximum of the distribution increases rapidly. On the other hand, 
for large values of c, the maximum of the distribution is not very 
pronounced, and the amplitude can take values in a wide range. 

Starting from the probability density (5.8) and making the change of 
variable x=a?—1, we find that the moments of the amplitude are 
given by 


l _ 
CO ee See adx, (5.11) 
~1 


To evaluate <a*), it is convenient to use the following recurrence 
relation, obtained from (5.11) by integration by parts: 


ca?) ae <a*y - ~ | (1 + Nyx elite dx 
=| 
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co] 
c aye: ck og) Lesa 
mA + xf e a +5 fate Io w2e ly , 
= 2 


xan] 
(5.12) 
Setting k=0 in (5.12), we obtain 
c 
(a?) = 1+ es (5.13) 
while if & > 0, then 
| re 
cat *?) — Cah) = 5 Cal). (5.14) 
In particular, we have 
c 
(a*) = (a) +e=1+e+—e°', 
N 
(5.15) 


Cc 
<a°> = (a*) + 2¢ (a*) =1+3ce+(1+ 20) 5 ", 


Before we can use Formula (5.(4) to find the odd inoments, we must 
first find the quantities <a~'} and <a). It turns out to be convenient to 
introduce special notation for the integrals 


Z,(y)=2 [oo dr, Z,))=2[ ore dt, (5.16) 
Q Q 


in terms of which <a~') and (a) are given by the formulas 


2 r a* a’ 
a4y=— eile eee Wee 9 
(a= He mF ee 

0 


(5.17) 
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It is not hard to show that the integrals (5.16) have the Following 
representations in terms of cylinder functions of fractional order:? 
Zi(y) ="? "Ky ,4(2y’) for y>O, 

Z,(y)= yp? e?” [K, ,4(2y’) +1 J2 Ty 44 (2y’)] for y <0, 

Z,(y) = ye’ [Ksj4(2y’) — Kiys(2y*)] for y >0, (5.18) 
Z,(y)= [y[?/? 2" [K3j. (2y*) + Kj (2y’)+n J2Isj4 (2y”) 

+ xJ2h (2y’)] for y<O. 

Numerical values of the Funclions Z, aud Z, are given in Table 1; the 
second of these Functions will also be needed later (see Chap. 7, Sec. 1). 
Using these functions, we can examine how the moments (5.17) depend 
onc. When c~1, it turns out that the fluctuational scatter causes the 


quantities (a> and <a~') to differ from unity, but not drastically (by 
less than a factor of 2). 


TABLE 1 

x | BV) | zu— Vf) | zacv xf) | Z0(- V7 
0.) 1.4058 2.6196 0.3399 1.2993 
0.3 1.2163 3.8250 0.238] 2.5743 
0.6 1.0843 6.3355 0.1777 5.7653 
0.9 1.0050 10.4622 0.1453 | 11.851 
1.2 0.9494 17.4873 0.1245 : 23.498 
1.5 0.9067 29.6282 0.1094 45.629 
1.8 0.8721 50.8187 0.0984 87.481 
2.1 0.8432 87,9723 0.0898 166.23 
2.4 0.8191 153.512 0.0822 313.99 
2.7 0.7987 269.57 0.0764 $90.52 
3.0 0.7802 475.61 0.0707 1106.0 
3.4 0.7561 1019.17 0.0669 2544.0 

0.7400 2197.4 0.0578 5823.6 


In the case c <1, when the noise intensity is relatively small, we can 
use the familiar asyinplotic expansions for the cylinder functions 


2 The details are given in the Supplement, p. 144. 
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figuring in (5.18) lo obtain the Formulas? 
<a ')=14 4¢4+ O(c’). 
<a) =1— de + O(c?). 

According lo (5.13), For small c we have 
<a’) = 1 (5.20) 
lo even grealer accuracy. Together (5.19) and (5.20) lead to the 


following approximate expression for the variance of the amplitude, 
valid for ¢<\: 


(5.19) 


Da = <a’) — (a)? =~ + O(¢?). 


IG 


; (5.21) 
((A — Ag)*> = (Ka?) — 2a) + 1)A5 = 440 + O(c"). 


For the time being, we confine ourselves (o these results, postponing 
examination of the phase until Chap. 7, Sec. !. 


2. The Linearization Method 


The method based on the Fokker-Planck equation and on equations 
containing delta-correlated processes is applicable onlv i! the corte- 
lation time of the noise is small compared (o the relaxation time, i.e., 
if the tondition (4.59) is satisfied. The advantage of the linearization 
method, which we now explain, is thal ils applicability is not limited 
by any conditions involving the correlation lime. A‘ the same time, 
compared to the stochastic method jus! discussed, the linearization 
method has the disadvantage that (he size of the fluctuations tnust be 
res(ricted. In fact, a necessary condition for applying this method is 
(hat the fluctuations be small enough to permil us to linearize the 
basic equations, i.e., {o retain only linear terms involving deviations 
from unperturbed quantities and drop all nonlinear terms. 

In studying self-excited oscillations in (he [inearizalion approxi- 
mation, there is no particular need (o eliminate oscillatory (crins in the 


8S 1, M. Ryshik and 1.8. Gradstein, op. cit., formulas (6.461 .5) and (6.461.6), p. 321, 
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nonfluctuational parts of the standard equations, since their presence 
does not prevent us from solving the problem. However, the non- 
fluctuational parts of the standard equations are still simplified in the 
same way as before, i.e., we look for a transformation (4.42) carrying 
the averaged equations (4.39) into the nonoscillatory equations (4.44), 
which describe smooth variations of amplitude and phase, involving 
no oscillations. 

Denoting smoothly varying averaged trajectories by the label sm, 
we can write (4.44) in the form 


A $m = eG3, (Aga Pm) 5 Pom as eH, (An Psm) . (5.22) 


Under the transformation (4.42), the standard equations (4.33) go into 
the equations 


A* = 2G*(A*,9*,£), 9* = eH*(A*, 9%, £) (5.23) 


[cf. (4.58)], which give the trajectories with fluctuations taken into 
account. In the linearization approximation, the deviations 


6A = A* ez 7, dy = o* — Pom (5.24) 


from the smoothly varying values must be small because of the small- 
ness of the random excitations. Subtracting (5.22) [rom (5.23) and 
retaining only linear terms of the expansions in powers of 6A and do 
with averaged coefficients, we obtain the following linear equations, 
which often turn out to be linear in (rt) as well: 


eG* A m> ace, Ase. 5 
bA=E au(As Pom) 5 4 +E Gao (Asm Pam) 5 5 
+ eG* (Asm Psms g) - eG (Agu Psm)s 
oH Aas $ eH; Ags Sim 
5pm 0 tat em Pam) 5 4 4 OH ae (Aam Pan) 5, 
aA. sm 
+ eH* (Asm P sm é) a eHs (Agms P sm) . 
(5.25) 


Suppose we apply the procedure just described to the equations 
(4.57), which have exact unsimplified fluctuational parts. In this case, 
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the linearized equations (5.25) take the form 


Asm 
ce me == | 5A — em€ sin (Wot + 9,,,) 5 


5.26 

5g 200 9 Bam 1 §A = — Fees (igh 4g.) ee 

oe — ie ee G 
ae ae ae Wal + Psu). 
where A,,, and g,,, satisfy the equations 
A 
Ay = 72 (1 Ban. 

(5.27) 


2 2 4 
« é Mo Ave Asn 
Elia 2 (Yr ad nde 

16 *( Az a 


For example, consider the fluctuational deviations 
5A =A*— Ap, 59=0* — Oem 


from the stationary value of the amplitude A,,, = A, and [rom the phase 


2 


-Mol + Po, (5.28) 


Psm = — 16 


where , is some initial phase which we assume to be a random vari- 
able uniformly distributed in the interval from 0 to 2x. Then the 
equations (5.26) become 

5A = — 895A — EWSESIN (Wolf + Wo), 
2 (5.29) 
Soa Se E cbs (Oh 99): 


where 


The first of the equations (5.29) is a linear differential equation with 


solution 
fr 


5A(t) =— eg { elt“ E 1’) sin (ayt’ + Ga) dt’, (5.30) 
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where we have chosen the arbitrary constant of integration in such a 
way that 6A(t) is a stationary random process beginning in the remote 
past. Multiplying (5.30) by the similar expression evaluated at the 
time t+, and then averaging the result, we obtain the correlation 
function 

t ttt 
<5A5A,) = 67005 i | eee (5.31) 


-@m-"o 
x CE(t’)E(t") sin (wyt’ + Gg) sin (Mt + wo) dt’ at”. 
If the noise is stationary and statistically independent of the initial 
phase ¢, of the oscillations, then 


KE (1) E(t") sin (@,t' + Go) sin (w,2" + Po) (5.32) 
=4E(1}E(’) cos w, (t' — 1’), : 


since 


(sin (wyt' + @q) sin (wt + @o)) 
= 4<cos w(t’ — t’)) — $ (cos (w,t’ + wt” + 2G) 
= cos w, (t’ - ft’). 


Substituting (5.32) into (5.31) and making the change of variables 
P—-’+t50, 

ae 

aes 


5, 


we can write the correlation function in the form 


o ttt 4]o] 


2,2 
(6A 5A.) ss Wo { do | eo o(2t+ 4-25) 


2 
x << a) COs w,(¢ = t) ds. 


Evaluating the integral with respect to s, we obtain 


<5A 5A,> = | e™I"ICEE S cosw,(o—t)do, (5.33) 
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which, in particular, implies 


<(5A)*> = | CEE, Cosca, 6 da 
0 
and 


Lt] wm , 
| <6A 6A, dt = : | <E€,> cos @,e@ do = > (,). (5.34) 


— ao 
We can also express (5A”) in terms of the spectral density of the noise 
E(t): 
((6A)) = | 
4n 
—-@ 
The results just obtained are valid subject to the condition that the 
nonlinear terms can be neglected in linearizing the first of the equa- 
tions (4.57). This condition reduces to the inequality 


<(6A)?> < AG, (5.36) 


2,2 
€ Wo 


ewe + (@ — @,) 


3k (w) da. (5.35) 


which implies that 


with overwhelming probability. Using (5.35), we can write the criterion 
(5.36) for the applicability of the linearization method in the form 


wo 


1 2,2 
| ee po <A (a, Xa). 
1 


“2,2 
& ag +(@ —w 
—@ 


Approximating the integral on the left, we can write this condition as 
Mo + 4ec09 
| k(w)dw < Aj. (5.37) 


wa 4ea9 


1 
4 


Unless the noise is very narrow-band, (5.37) can be reduced [urther to 


I 
4 EK (Wo) < Aa 
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or 
ee 
j : 


On the other hand, formula (5.33) is valid for arbitrary correlation 
times (provided there is no dependence between € and 9,), including 
small correlation times which satisfy the condition (4.59). In the latter 
case, the linearization method and the Fokker-Planck method are 
both applicable, and naturally they both lead to the same result. In 
fact, when the correlation time is small compared to I/ew, the 
function <€&,_,) in (5.33) has a sharp maximum for o=7, and is 
appreciably different from Zero only in a narrow range near this value. 
Therefore, in this case, the much more slowly varying function 
el?! appearing in the integrand of (5.33) can be replaced by 
e~ oll and as a result we obtain the expressions 


(5A 5A.) = = e~ ewoltl { (€€,_,> cos w, (0 — t) do 
og (5.38) 


EWo = 
= —x(w,)e 
4 
and 


((6A)*) = “o «(@,) = “A. (5.39) 


An exponentially correlated Markov process has a correlation function 
like (5.38). This is no coincidence, in view of the fact that stochastic 
methods are applicable whenever t,,, < 1 /ewp. Correspondingly, formu- 
las (5.38) and (5.39) can be obtained by using the Fokker-Planck 
equation and equations involving delta-correlated random processes. 
Thus the fluctuational scatter of the amplitude given by (5.39) is the 
same as that given by the expression (5.21) found earlier. 

If only one of the conditions (4.59) and (5.37) is satisfied, then the 
choice of the method is unique. Thus the general form of the distri- 
bution function cannot be obtained by the linearization method, while 
on the other hand, the general formula (5.33) cannot be derived by 
using Markov process methods. 

Returning to the second of the equations (5.29), we note that the 
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first term, containing the deviation 5A given hy formula (5.30), is 
much smaller than the second term, and hence can be neglected. As a 
result, we find that the phase shift after time T is 

T 


€q) 
Ag = dg7 — 69 = — ?*{ E(0 cos (cof + Po) dt. (5.40) 
0 


It follows that the variance of the phase shift is 


<(49)’) 


t” + Mo) dt’ dt”, 


which gives 


((49)*) = 5 sil 1) Cos wn, (1! = #")dt’ dt” 
(5.41) 


— |t{) CEE, cos wytdt. 


under the same assumptions as those leading to (5.32). For large 
times T, which greatly exceed the correlation time r,,,, the phase shift 
acquires a “diffusional character,’’ and the dependence of the variance 
of the phase shift on time approaches a direct proportionality, Le., 


<(4g)*) = DoT, (5.42) 
where 


Do & re $f | aoe dt = ee (5.43) 


The example analyzed in this section shows that in applying the 
linearization method to linearized equations of the type (5.25), we can 
make fruitful use of the correlation theory. In just the same way, 
various other problems can be solved in the linear approximation, 
some of which will be considered later (see Chap. 6, Sec. | and Chap. 
9, Sec. 1). 
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3. The Quasi-Static Method 


The apparatus of Markov processes is no longer applicable when the 
correlation time is comparable to the time constants describing the 
rate of change of amplitude and phase, i.e., the amplitude relaxation 
time and the phase relaxation time (provided the latter exists). A 
fortiori, Markov process methods cannot be applied when the corre- 
lation time exceeds these time constants. However, suppose the corre- 
lation time greatly exceeds the relaxation time T,,,, as is the case when 
the fluctuations change very slowly, so that 


T cor > Tet ; (5.44) 


Then (5.44) can be made the basis for applying the so-called quasi 
static method, which is essentially the opposite of the Markov process 
method. 

In the quasi-static method, we simplify the equations in standard 
form (4.33) by looking for a transformation from A, to a new 
amplitude and phase A*, g* which eliminates oscillatory terms not 
from the equations (4.39), but rather from the equations 


A = E(G)s = cous b] ? =e CH) sae ? (5.45) 


which differ from (4.34) in that € is regarded as a constant parameter. 
Apart from this difference, the indicated transformation is found by 
the same method as before, i.e., it is the same as (4.42) except for the 
fact that it explicitly depends on &. If it is not the process €(t) itself 
which is slowly varying, but rather certain parameters of €(r) [like 
oe(t) and y(r) iu the example given below], then these parameters 
should be regarded as constants in (5.45). 

Applying this transformation to the actual] standard equations (4.34), 
in which &(¢) [or e(0), x(1), ..-] vary in time, although slowly, we ob- 
tain the complete nonoscillatory equations 


A*=G*(A%,0%8), ot =eH*(A*o%8). (5-46) 
If we now impose the condition that the correlation time be so large 


that “quasi-stable” values of the amplitude and phase manage to be 
established for every value of E(t) [or a(t), x(#), --.], then 


G*[A*,9*,E(Q] =0, A*[A*@",6()]=0, (5.47) 
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where these equations are obtained by setting A* = @* =O. If the right- 
hand sides of (5.46) involve the time derivatives Z(or ¢. %, ...), then 
these derivatives can also be set equal to zero (this is justilied by the 
same argument as used to write A*=¢*=0). 

The equations (5.47) determine the amplitude and phase as zero- 
memory functions of the noise, i.e., as functions of the value of €(f) 
[or e(t), x(t), ...] at the same instant of time. To find the statistical 
characteristics of the amplitude and phase. it is now sulficient to use 
the theory of zero-memory nonlinear transformations, presented in 
Chap. I.8. To obtain more exact results, the zero-ineinery amplitude 
and phase determined by (5.47) can be taken as first approximations, 
and higher approximations, corresponding to small deviations, can 
then be sought by using (5.46). 

To illustrate the quasi-stalic method, we consider the effect of a 
narrow-band perturbation 


E(t) =— a(t) sin [(@ — A)f + 7(1)] (5.48) 


on the vacuum-tube oscillator described by the equations (4.36), 
confining ourselves to the first approximation, where o(/) and 7(¢), the 
amplitude and phase of the noise, vary sufficiently slowly. To be 
explicit, we assume that the amplitude has a Rayleigh distribution 
(see p. I.]92) 


w(e)do = Serene do =—d(e 2?) , (5.49) 
0 


where o2 is the variance of (5.48), under the assumption that the 
initial phase is Completely random: 


<8") = 440") = 00. 


Representing the fluctuational terms in the form 


ew 
— ew, t sin ® = e[cos(x-@ — At) —cos(2wyt — At + x+)], 


— &M,é cos P = =e [sin(y — gy — At) + sin(2mot — At -+ 4+ )] 
(5.50) 
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(note that At= 4-1), we drop the oscillatory terms in (4.36). As a 
result, we obtain the following “truncated” equations for the first 
approximation [cf (4.41)]: 
. EW A*\ ea 

A= — Al l=. |4— — Ww), 

5 (: 3) 5 ecos(x— ¥) 

. F103) : 5.51 
b= A+ esin(x—W) (b= + At). oo 
It is clear from (5.51) that the relaxation time of the amplitude is of 
order ]/ewo, while the mean relaxation time of the phase can be esti- 


mated as 
2A 1 Ag 
Tet = et tide eae (5.52) 


EWo0 EW, Bo 


Thus, in the present case, the conditions for applicability of the quasi- 
static method take the form 


1 
Teor > ——> Teor ea aes (5.53) 
EWo 


If these conditions are satisfied, then the amplitude and phase manage 
to take “‘quasi-stable” values causing the expressions (5.5]) to vanish. 
Equating these expressions to zero, we obtain 


A? 2AA 
gens (nv) = A(4.—1), eC Saad ear rine (5.54) 


Squaring both equations (5.54) and adding the results, we find that 


2 2 A’ 24 \? 2 A’ 
ot =A (4:-)) t\ee = 4/(5). (5.55) 


Equations (5.54) and (5.55) represent necessary but not sufficient 
conditions for the existence of stable values of A and yw, and the 
stability of these values must still be verified. Let 6A and dy be the 
small deviations of A and w from their stable values. Then, using 
(5.51), we find the following linearized equations for 6A and dy 


5A = ay, 5A + ay, Oy, 


dy = a2, 6A + ao. dy, 228) 
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where 
éG EMo 34. ; 
= 6— =— --—— Satie eel 7 
omy 2 \° 42 
0G £@) 
a Yeas =z esin(y—W) =— Ad. 
5.57 
oH EM A G3) 
da =& = — 5 esa -W) = + 
oH EWo eae ; 
= f-—--=— -—-pco = —— al 
a aay s(x — ¥) 2 lui } 


[we also use (5.54)]. The system (5.56) is equivalent to the second- 
order equation 
6A — (a4, + 4,,)6A + D5A=0, 
where 
D = 441429 — 42421, 
from which it is easily seen that a necessary and sufficient condition for 
stability (i.e., for the deviations to decay in time) is that 


44, +4,,<0, D>O. 


Taking account of (5.57) and using the function defined in (5.55), we 
can write these conditions in the form 


A? A? 
—=>- "| -3}]>0, 5.58 
are 13) a 
where 
dz ° 
Next, assuming that 
2A 1 
a ee (5.59) 
EM 2 


we investigate the region of possible values of the quantity z= A?/A@. 
The function f(z) has a positive derivative for 0<=<-z, and for =>z., 
where z, and z,(>z,) are the roots of the equation f ’(=)=0, equal to 


1 2A \* 
aany[2zy1-3(4) | (5.60) 
EWo 
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(note that At=A-t), we drop the oscillatory terms in (4.36). As a 
result, we obtain the following “‘truncated’* equations for the first 
approximation [cf. (4.41)]: 

. EDs A? EWo 

A= 57 ( -a)*5 ecos(x— ¥), 


WH At Pesin(x—W) (y= + Ar). ook) 


It is clear from (5.51) that the relaxation time of the amplitude is of 
order 1/e@ , while the mean relaxation time of the phase can be esti- 


mated as 
2A 1 A 
Ta = ( ) aa, (5.52) 


EWMoC 


Thus, in the present case, the conditions for applicability of the quasi- 
static method take the form 
1 

Teor > ae. Teor Seen, py (5.53) 
If these conditions are satisfied, then the amplitude and phase manage 
to take “‘quasi-stable” values causing the expressions (5.51) to vanish. 
Equating these expressions to zero, we obtain 
2 


A 
gos (x ¥) = Al 


= \) esin(x-—w)=-— ee ; (5.54) 
Ao E 


Wo 


Squaring both equations (5.54) and adding the results, we find that 


Be NA SF OAN" ; 
reall) Sa ea) 0 


Equations (5.54) and (5.55) represent necessary but not sufficient 
conditions for the existence of stable values of A and w, and the 
stability of these values must stil] be verified. Let 6A and dy be the 
smal] deviations of A and wy from their stable values. Then, using 
(5.51), we find the following linearized equations for 6A and oy 


6A =a,, 6A + ay, dy, 


; 5.56 
by) = ay, 6A + a3, OY, 2") 
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where 
dG EW, (A? 
aa ) a i oe ; 
0G ew 
ae ag, “5 esin(x—)=— Ad, 
oH EWo sin ( v) A (5.57) 
=&—" => — ---; l —_ = -- 
ale 7 ea 9 ta A’ 
OH EW EW { A” \ 
Pg shige a ay er. a4 
Q22 ay 54 2 cs y) ; (43 


[we also use (5.54)]. The system (5.56) is equivalent to the second- 
order equation 
5A —(a,, + a,,)5d + D5A=0, 
where 
D = 44,822 — 412494, 
from which it is easily seen that a necessary and sufficient condition for 
stability (i.e., for the deviations to decay in time) is thal 


a;,+4,,<0, D>O. 


Taking account of (5.57) and using the function defined in (5.55), we 
can write these conditions in the form 


A? 1 A? 
-s>- —_ 0, 58 
where . 
(2) 
dz ~ 
Next, assuming that 
24 =I 
—-'<., (5.59) 
eg 2 


we investigate the region of possible values of the quantity := 47/A?. 
The function f(z) has a positive derivative for O<z<7=, und for z>2., 
where z, and z,(>2z,) ate the roots of the equation ''(=)=0. equal to 


if, [fa 
sangl2s ft-3(24) | (5.60) 
Q 
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But clearly, because of (5.59), the first of the conditions (5.58) is 
violated (although the second holds). However, the values z>z, 
satisfy both of the conditions (5.58), and hence correspond to stable 
values of the amplitude and phase. Therefore, in solving equation 
(5.55), we must take only the larger root z>z,. However, the stable 
solution just described does not exist for all values of g. In fact, con- 
fining ourselves to values z>Z, We easily see that the function f(z) 
takes its minimum value f(z.) for the value z,. Therefore a stable 
solution of (5.55) exists only if 
2A 2744 {2 
a> a, = Ag[f(z2)}'? = Agz??? te -1f + (=) | . (5.61) 


0 


Because of (5.49), this inequality holds with probability 
P, =e M29, (5.62) 


In the opposite case, which occurs with probability |—P,, stable 
values of amplitude and phase are impossible, and the phase difference 
x—w grows without limit. Then the terms involving cos(y—) and 
sin(y—w) in (5.51) behave like oscillatory terms in the nontruncated 
equations of the type (4.40). Neglecting oscillations of amplitude and 
phase, we can then truncate the equations (5.51), just as was done in 
the case of (4.40). The result is 
A\ 
= Salt -&): y=A (or ¢=0), 

0 


where the first of these equations has the solution A = Ag. Therefore, 
with probability |—P, the amplitude takes the value Ay, and with 
probability P, it takes a value A> Ag,/z, given by (5.55). It follows 
that the amplitude distribution has a delta-function component 
(1 —P,)6(A—Ag), as well as a continuous Component Wesg,(A). To 
find Weonr(A), we substitute (5.55) into (5.49), obtaining 

A ts) 


{ Ween (Ay) dA, =P, — { Ween (Ax) 4Ay 


ie se Az Az 2 2A 2 
= Pisenpeo— || Sa) a) 
etal") +2) } 
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Therefore the complete probability distribution takes the form 
w(A) =(1 — P,)6(A — Ap) 


2A \? 
+ A al 30 —4a? +14 (=) | 
Tog ED 
At 
where 


In the special case where 4=0, according to (5.60)-(5.62) we have 
z,=1, e, =9, P,=1. 


Therefore the delta-function term in (5.62) drops out, and the formula 
becomes 


2 
w(a) = Bate? ~1)(3a? — exp - mae (a? — vy (a > 1). 
(5.64) 
The form of the distribution (5.64) is shown in Figure 17. 
It will be recalled that in formula (5.8), the size of the fluctuational 
scatter is determined by the parameter c. In the present case, a similar 
role is played by the parameter o%/A@. If this parameter is small, i.e., 


at 
1 15 a re 


Fig. 17. Probabllity density of the amplitude for excitation by narrow-band nolse 
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if i 
0 
= <1, 5.65 
Zz (5.65) 
then 2 
a-1i<¢1, «@>-1€l, (5.66) 
and hence 


a®>~1x2(a—-1), a*(a?-1) ~4(a—-1), 3a? -1 2, 
so that the distribution (5,64) becomes 


w(A) = 4 Am Ao 9 204-Aay8, (5.67) 
% 
Thus, for small values of the parameter 02/42, (5.64) approaches a 
Rayleigh distribution, shifted along the A-axis. Using (5.67), we find 
that 2 
(A- Ay =>. (5.68) 


Since the inequality (5.65) is the condition for the applicability of 
the linearization method, we might expect to obtain the relation (5.68) 
by using this method. Linearizing the equations (5.51) with respect to 
the deviations 6A=A-—A, and xy—yW, which are assumed to be small 
[a condition for the smallness of x—w is that the changes of the 
function x(t) be small], we have 


€@ 
6A = — 6a) 5A +~e, 


p=4 +54, e900 -¥)- 


It is not hard to write the solution of these equations in quadratures. 
Thus the stationary solution of the first equation is 
t 


6A(t) = = { el“ a(t) dt'. 


In particular, this leads to the correlation function 


(04 6A.) = “ | ello, _,>do, (5.69) 
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analogous to (5.33). If, besides the assumptions already made, we now 
assume that the fluctuations change slowly, i.€., Teo > I/e@o [ ef. (5.33), 


then (5.69) implies (5A 5A.) & 400,). (5.70) 


In fact, in the expression (5.69), the exponential factor changes much 
more rapidly than (¢g,-,> and cuts a narrow interval out of the range 
of integration, where 


1 
¢S—<Tt,,, and <ee,_,) = Ceg,>. 
€w 


Therefore, we can bring (eo,> out in front of the integral sign, thereby 
obtaining (5.70). In particular, setting z=0 in (5.70), we find that 


2 
((54)?) = 440) =, 


which indeed agrees with (5.68). 

Thus, just like the stochastic method, the quasi-static method, 
which is the diametric opposite of the stochastic method, shares a 
region of applicability with the linearization method. 


4. Summary of the Applicability of the Various Methods 


Summarizing the results given above, we can assert that whether or 
not a particular method is applicable depends on the one hand, on the 
rapidity of change of the fluctuations (in other words, on their spectral 
composition), and, on the other hand (independently of this rate of 
change), on their intensity. Here the correlation time must be com- 
pared not with the period of the oscillations, but rather with the 
relaxation time. In spectral language, this means that the bandwidth 
of the noise perturbations is to be compared with the bandwidth of the 
generated signal. If the noise spectrum has greater handwidth Aw than 
the spectrum of the Self-excited oscillations (Aw>ew,>, then the 
apparatus of Markov process theory is applicable, and we can use the 
Fokker-Planck equation and equations involving delta-correlated pro- 
cesses. On the other hand, if the bandwidth of the noise spectrum is 
much less than ew,, then the quasi-static method is applicable, and the 
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change of amplitude of the self-excited oscillations reduces to a Zero- 
memory dependence on the noise. This applies to the case where the 
relaxation time of the phase bears the same relation to the correlation 
time as the relaxation time of the amplitude. Of course, more compli- 
cated, combined situations are possible, where, for example, the 
relaxation time of the phase exceeds 1,,,, so that the stochastic method 
is applicable to the phase equation, while the relaxation time of the 
amplitude bears the opposite relation to 7,,,, so that the amplitude 
equation can be regarded as quasi-static. For simplicity, however, we 
shall not consider such cases. 

Over and above any dependence on the correlation time, we can use 
the linearization method if the noise perturbations are small. The 
relevant linearized equations, whose solutions can easily be written in 
quadratures, reduce the problem toa linear transformation of a random 
function, and consequently we can use correlation theory to look for 
amplitude and phase correlation functions. In many cases, where the 
random excitation is Gaussian or the correlation time is small, we can 
also find amplitude and phase distribution laws which are themselves 
Gaussian. In applying the linearization method, it is not the actual 
size of the random [unction €(f) that matters, but rather the fluctu- 
ational scatter of the self-excited oscillations produced by €(t). Strictly 
speaking, we should compare the standard deviation o(A)= a <(5A)?)> 
with some “measure of nonlinearity,’ which might be defined, for 
example, by the formula 


eG 
Py aA 
= 3G" 
aA? 
Then the condition a(A)<AA 


says that the quadratic term (@7G/@A’)(5A)* plays a small role 
compared to the linear term (€G/@A)5.A, However, in most cases, 4A 
is of the same order aS Ay, and hence o(A) can be compared with A, 
instead of with AA. In other words, since order-of-magnitude esti- 
mates are sufficient, the sign < can be interpreted rather loosely 
in deciding whether or not the linearization method is applicable. Thus, 
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for example, we can estimate <(5A)*> by using the Jinearization 
method, even if, strictly speaking, it is not known tv be applicable. 

In this chapter, we have considered the case of an additive fluctu- 
ational term, which is not involved in the nonlineartuy but is merely 
added to the equation describing the oscillations. Using this example, 
we obtained the condition (5.36) for the applicability of the linearjza- 
tion method, in the form of the inequalities (5.37) and (5.621. We can 
also write (5.62) in the form (5.37), since in the case where g(t) and y(f) 
are slowly varying, the whole spectrum is concentrated sear (9, so 
that 


wo ap + dean 
l | 
a5 = {eo da) = - | kK (io) deo, 
rt nt 
0 ay — teu 


Therefore, in the case of an additive fluctuational term, the inequality 


tigt 46M 


l 
4 i K(w)dw < Aj 


Wo — $Fup 


TABLE 2 


Intensity of the noise 


Rate of change 
of the noise 


Small: <(dA)*?> < A; Large: « (0.4)? > ~ A 


]. Linearization Markov process method 
method and 
correlation theory 

2. Markov process 
method 


Large: V/Tcor 3 ewo 


Linearizalion method 
and correlation Lheory 


Intermediate: 1/tror ~ ewa 


I]. Linearization Quasi-static method 
method and 
correlation theory 

2 Quasi-static method 


Small: ]/teor < ews 
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is equivalent to the condition (5.36) for any rate of change of the 
random excitations. 

The vastous methods for studying self-excited oscillations in the 
presence of noise, together with conditions for their applicability, are 
summarized in Table 2, where, as just remarked, for the case of 
additive noise Whose spectrum is concentrated near the fundamental 
frequency w, and has no sharp maxima at other frequencies, the 
quantity ¢(5A)*> can be estimated by the expression 

Mp + 42M 
; | K(w) dw. 

Bo — $eWo 
In some columns of the table, it is shown that two methods are 
applicable. At the same time, at the place in the table corresponding to 
the conditions 

Teor ~ EW: <(6A)’> a Ag > 


it has unfortunately been necessary to leave an empty space, since 
sufficiently simple analytic methods suitable for this case are not 
known. 


Supplement 
* Here we supply the details of the calculations leading [rom (5.16) 


10 (5.18). To derive the first of the formulas (5.18), we make the change 
of variable r=2y"/? sinh &, obtaining 


e roy 
2 id, = ayt?? [ e274 cosh E dé 
0 0 


i pi ae n cosh 7 dy = vy? Ky i4(2y’), 
0 


where the last step follows from formula (6.444.1) of Ryshik and 
Gradstein’s handbook (op. cit., p.317). 
The third of the formulas (5.18) is easily deduced from the first by 
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noting that 


and hence 


lad ‘ 
Z2 (y) == 4 ae [y'/?e?” Kijs (2y*)] 
pea (5.71) 
2 12 2 
= rial dy [y?K,)4(2y7)] — ye? Ky,4 (25°). 


1/2 dz a 4 ; 
=p Rijs (2y? N= dy ae I(G) Kal). 
where z=2y?. By formulas (6.496.14) and (6.496.16) of the handbook 


cited, we have 
4 
) Ky,,(2). 


£6)" sa0]--()"=m0~-( 


Therefore 


But 


Nila 


d 
dy Ly? Kiya (2y°)] = 4y Kyi (2y7) , 


which when substituted into (5.71) gives the third of the formulas 
(5.18). 

To derive the second and fourth of the formulas (5.18), we have to 
make the complex continuation of the first and third formulas corre- 
sponding to the substitution y>e™y5, where Im }-9=0. Starting from 
the relations 


K (2 )= nt i ) 


I, (e7"! z) = aa 3 (z), 


[see formulas (6.495), (6.455), pp. 328, 319 of Ryshik and Gradstein’s 
handbook], we find that 


(e78lz)i4 Ky ,4(e""2) = ae" U-1,4(2) + hja(2)] 


= 2" Ky 4(z) + f2hj4(2)]. 


(5.72) 
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and similarly, 


ni x 
(e?"z)!* Ky 4 (e? z) = V2 git [i- 3/4(2) + Iya (2)] 


=z°!t [K3;4(2) +% V215,4(z)]. 


(5.73 


According to (5.72), 


Z,(e™yo) = (e"yy)'? eK 4 (e’™ 2y9) 
= yg!" e% [K1)4(2y0) a J 2h ja(2y'0)] , 
which is just the second of the formulas (5.18). Similarly, using both 


(5.72) and (5.73), we can easily verily the fourth of the formulas 
(5.18).* 


CHAPTER 6 


Effect of Weak 
Internal Noise on an Oscillator 


Suppose no external noise acts on an oscillator. Then, even if the 
operating conditions (e.g., the supply voltages and the temperature) 
are perfectly stable, the same will not be true of the self-excited oscil- 
lations. Thus the constancy of the amplitude and frequency will be 
destroyed by internal noise, i.e., noise arising in the components of the 
oscillator circuit, The primary source of internal noise is the vacuum 
tube itself, in which shot noise and cathode ion noise are present. Here 
we shall consider only the shot noise, since it is predominant at high 
frequencies and has been studied in greatest detail. Apart from the 
vacuum tube, thermal noise of thermodynamic origin can also arise 
in the active circuit resistances. The spectral density of the fluctuating 
e.m.f. @ arising in a complex impedance Z(iw) is given by Nyquist’s 
formula 

S[@;@]=4kT Re Z(ia), 


and hence is proportional to the active resistance R=ReZ. In a 
vacuum-tube oscillator like the one shown in Figure 12. with an LC 
tank circuit and inductive [eedback, the main circuit elements are not 
active resistances. In fact, too high an ohmic resistance in the induc- 
tance would destroy the QO of the tank circuit, and the other resistances 
also play a minor role. Therefore thermal noise is not decisive in such 
circuits. 

Of course, in some cases it may not be permissible to neglect thermal 
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fluctuations. or example, a resonant circuit whose active resistance 
contributes important thermal noise may be present in the grid circuit 
of the oscillator. Thermal noise may also be important in oseflators of 
the RC and other types, where active resistances appear as basic circuit 
elements. Lfowever, taking account of the thermal noise does not 
introduce any hindamental difficulties nor does it change our methods 
of calculation, In principle, thermal noise is even simpler than shot 
noise, since it is always stationary, with a uniform spectrum. We shall 
not consider thermal noise further, since its only effect is to increase 
both the fluctuational scatter of the amplitude and the amount of 
diffusion of the phase. 


1. The Low Intensity of Shot Noise and the 
Linearized Equations 


The considerations of this chapter will be illustrated by the example 
of the vacuum-tube oscillator shown in Figure 12 and discussed in 
Chap. 4. The operation of this oScillator is described by equation 
(4.12), which takes the form (4.20) in terms of the coordinate (4.18). 
If we introduce the quantily 


é(1)} = 


[cf. (4.26)] and use the simplest approximation (4.23) for the tube 
chiracteristic, then the equation describing the oscillations becomes 
(4.24), to which everything said in the last two chapters applies. 

We begin by estimating the dimensionless parameter 


Wag MI,(1) 
E 


(6.1) 


oa Balk (20) (6.2) 

Ag 
for the case of shot noise [cf. (4.79)]. This parameter determines the 
extent to which the noise affects the operation of the oscillator. 
Suppose the average anode current Js constant and suppose we neglect 
the effect of both space charge and the cathode-anode electron transit 
time. Then, according to formula (1.6.40), the shot noise is stationary 
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and has the correlation function 
ily = eh 5(), (6.3) 
Therefore it follows from (6,1) and (6.2) that 


w- 
K(w) = 2 M7e(1) 


1 fw M\? 
c= -( ) Meh). (6.4) 


Next we estimate (6.4) for the example given on p. 96, where Ay, 
the amplitude of the oscillations of grid voltage, equals I]v, while 
<i>, the average anode current, equals 0.047a. Substituiing these 
values (and the others given on p. 96) into (6.4), we lind that 


and 


ear x1 = 12 x 107, (6.5) 
The extremely small size of the constant c shows that shot noise has a 
very small effect, in particular, that the departure of the amplitude 
from its stationary value js small. Thus we are justilicd in using the 
linearization method to study shot notse. 

It is interesting to note that the small value (6.5) is oblaincd despite 
the appearance of the small parameter c in the denonunator. If we 
decrease ce, without changing the parameters wo, M, 4, ¢1,>, then, 
sooner or later, a point is reached when ¢ is no Jonyer sinall, regardless 
of the smallness of the shot noise itself. Then the linearization method 
becomes inapplicable, and the problem can only be solved by applying 
the apparatus of Markov process theory. 

The low intensity of internal noise is perhaps its most characteristic 
feature. Another characteristic feature is its broad-band nature, Le., 
its Small correlation time. Naturally, in an anode current undergoing 
shot noise fluctuations, correlation is preserved for the duration of a 
current pulse due to a single electron, but the correlattan disappears 
to the extent that electrons in the cathode-anode inlerspice are re- 
placed by others. Therefore the correlation time of shol notse equals 
the time of transit of electrons going from the catliode to the anode. 
This time is ordinarily much smaller than either the relaxation time or 
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the period, a fact which guarantees the applicability of stochastic 
methods to the problem of shot noise. Actually, this fact makes the 
study of internal noise the simplest of all problems associated with 
noise in oscillators, thereby allowing us to obtain very complete 
answers to all questions of interest. 

In the estimate of the quantity c just given, the average anode 
current was assumed to be constant, and other simplifying assump- 
tions were made as well. Failure of these assumptions to hold will not 
change the order of magnitude of c, which will still be much less than 
unity. Therefore both the {inearization method and the stochastic 
method are applicable to the problem of internal noise in oscillators, 
even when the specific conditions of the problem are taken into account 
more fully. 

The linearization method is the basic method to be employed below. 
However, the smallness of the correlation time will be used to further 
simplify results which would hold in the absence of this condition. 

If instead of (4.23), we use the better approximation (4.22) to de- 
scribe the tube characteristic, (4.20) takes the form 
2 


ra) +ozee(), (6.6) 


@ xX 4 
2@,A, 3648 


X + wWEx = ea ( ++ 
where 
Mo MP Ag 
e= Sageee 


which differs from (4.24) only by the presence of the term @x/2a% Ap. 
The equations in standard form corresponding to (6.6) are 


ECD, 
a= all — a? — joa sin & + ($a7 — 1)cos 26 
. @ ; 
+4oasin Ib —4a? cos 4¢@ | - =" & sin ?, 
0 


€@ 
oe od bs foacos 6+ (1 — }a’)sin 2 


&@ 
+ loacos 36 +427 sin 4@ | — 0 * eos ?, 
o a 


(6.7) 
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where as usual a=A/A,. Then, by dropping oscillatory terms pro- 
portional to sines and cosines of &, 2%, 38 and 44, we obtain the 
“truncated” equations, which differ from (4.41) only by the presence 
of the fluctuational terms. Corresponding to these truncated equations, 
we have the linearjzed equations 


xa) 
bd = — ewoda — — & sin (wot + Wo). 
Ay 
x (6.8) 
69 =— —2¢ Cos (Wof + Qo), 
Ag 


where, as usual, da=a—1, dP=Y—@o. 

Since the Ructuations are very small, the changes in amplitude and 
phase due to the noise are much smaller than (he oscillations of 
amplitude and phase which invariably accompany nonlinear oscil- 
lations and are coherent with the basic frequency. Let us exaniine the 
principal oscillations of the latter type. This is done by going ever to 
nonoscillatory values of amplitude and phase, defined hy the trans- 
formation of variables 


a=a*+eu(a*,*), 


6.9 
go = 9" +ev(a*, *), en 


where $* =f +¢—*. To a first approximation. the functions 1 and p, 
defined just as on p. 102, are given by 


u(a,®) = s| 2 cos & + 2(4a7 — 1) sin 2¢ 
2 
ae cos 3h — : sin 10], 
3 3 
l : 
v(a,®) = 2 — gasin @ + 2(4a° — 1) cos2@ 
{ Vr 
+ “ sin Ad — COS so], 
3 3 


(6.10) 
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Then (6.9) transforms (6.7) into the nonoscillatory equations 


a* = — a*(1—a™*)—--- Esin®", 
2 Aa 
£°a@ EM, ¢ 
e* = rae — 4a*? +o0'a"* + 3a**) = a = cos o*. 
o @ 


(6.11) 


The process of making the nonoscillatory components of the ampli- 
tude and phase more exact can be extended to higher orders in «. 
However, we shall confine ourselves to the most important compo- 
nents, given by (6.10). Using (6.9) and (6.10), we can easily express the 
generated signal x in terms of the nonoscillatory amplitude and phase 
[cf. (4.54) ]: 


x F 
— = acos @ = a* cos &* + ev cos @* — ea” y sin g* 
a 


= a* cos 6* +200"? - 5a! — a") sin &* (6.12) 


£ P 
+ ae cos 26* + File sin 3@* 4 O(e7), 


When the oscillator has established a stationary operating regime, the 
amplitude a* is very close to 1, because of the smallness of the noise 
[this can be seen from the first of the equations (6.1 1)]. It follows from 
the second of the equations (6.11) that then the frequency differs only 
slightly from the frequency 


(WO, = Og — ool! + 40’) (6.13) 


(to see this, substitute a*=1). The deviations from the stationary 
values of the amplitude and frequency will be denoted by 


da=a*—-1, d¢=6*-a,. (6.14) 


Bearing in mind that these deviations are small, we deduce the following 
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linearized equations from (6.11): 


EWo. . 
bd = — t, da — -—-E sin (ail + Wo). 
Ag 
(6.15) 
; £°D, ‘ ED, 
6g =— — (1 + he*)da — - — Ecos (cyt + Gy). 
4 Ag 


The small values of the fluctuational deviations also allow us to 
transform the expression (6.12) for the generated signal into the form 


= &* 45a cos * 4-0 6a +—~dasing* +." 2—p* 
—-= COs a co = a — oa Sin | - 9 Cas zs 
Ac aaa 12° 


E £ £ "i 1 
+ ra da cos 2@* + 54 sin 3@* 4 A dasin3@* 4+ O(c) (6.16) 


(we omit a nonfluctuational term c@/4). Retaining only principal 
terms, we have 


~ = cos &* + 5a cos &* + ~acos2* + . sin 30". (6.17) 
Ag 12 24 

In the above derivation of the basic equations (6.15) and (6.17), no 
assumptions were made about the stationarity of the random ex- 
citations €(t), Therefore these equations can be used even for the case 
of nonstationary shot noise. 

The very low intensity of shot noise suggests that the corrections of 
higher order in ¢ might be larger than the shot noise itself, thereby 
making it necessary to calculate higher approximations. ITowever, this 
is not the case, and in fact, even the second-order Corrections just 
calculated are not really necessary, as can be secn by comparing the 
first and second approximations, [t will be noted that the second 
approximation (6.15) contains two corrections to (6.8): The first is a 
correction to the average generated frequency co, and the second 
consists of anextra ter minthe second equation. Actually, the correction 
to the frequency exceeds the fluctuational scatter, and the same will be 
true of the third and higher-order corrections, but these corrections 
are not of a fluctuational character. Thus the higher-order corrections 
lead to more precise values of the nonrandom parameters @, and Ag 
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appearing in the lineanzed equations, but this is essentially their only 
effect. The extra term 
— &'wo(1 + 40”) da 


in (6.15) plays a small role, since it is proportional to the fluctuations 
da, and moreover contains another [actor of &. The analogous terms 
introduced by the higher approximations will play an even smaller 
role. Therefore we can actually use the equations (6.9), provided 6A 
and 5¢@ are interpreted as deviations from the ‘true’ amplitude and 
frequency, where the latter may be determined to within less accuracy 
than the fuctuational scatter itself. In fact, we can omit all calculations 
of higher-order corrections by the simple exPedient of choosing the 
experimental values as the “true” amplitude and frequency. 


2. Shot Noise with Neglect of Periodic Changes of 
Anode Current 


If the average anode current <J,> is constant, the shot noise, and 
hence the random function €(¢) appearing in (6.8), will be stationary. 
If we neglect the time electrons spend in the cathode-anode interspace, 
the anode current will be a sum 


[,() = ey d(t-1,) (6.18) 
i 


of arbitrarily short pulses, where 1, is the random time of appearance 
(say, at the anode) of the jth electron. The average current 


CI,(1)> = en(t) (6.19) 


and the ayerage number of electrons #(f) in transit will be regarded as 
constant, Then, according to the second of the formulas (1.6.28), the 
moment function of the anode current determined by the sum (6.18) 
is given by 


CL) L(Y) = efi (O11) + ef (41), (6.20) 


1 The previous inexact values of @o and Ao can be used in the factors ews aod 
éwo/ Ao appearing in (6.8), since they are multiplied by the srnall quantities da and ¢. 
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where f,(f) is the univariate distribution function, equal to {t), and 
f,(t) is the bivariate distribution function (as delined on p. £144). 
Similarly, the correlation function of the anode current is given by 


K(L(9.2(00 =< (Oi (’p =eh (6-0) + eg 4-0), 
(6.21) 
in terms of the correlation function 


eh -h(ione), (6.22) 


introduced on p. I.147. In the stationary case, (6.22) becomes 
eo(t.¢)=e.(t-f)=f,(t-1)-f/. 


The function g,(t—1’) describes the correlation between times of 
flight of the electrons, where g,=0 in the absence of any such corre- 
lations. If correlations are present, but are sufficiently short-range, we 
can replace g,(t—1’) by a delta function: 


&2(t}> | &2(t)dt-5(c}. (6.23) 


Then, according to (6,21), the correlation function of [,(t) has the 
“delta-function shape” 


CE, (O I (t')> = Pref 6(t— f= L7e<h,yd(ct}. (6.24) 


where the coefficient 
l 
re=i+ Fal B2(t)dt (6.25) 
1 


is called the space-charge smoothing factor. This coefficient is close to 
unity if the tube operates near saturation, However, if the tuhe oper- 
ates in the range where the anode current is limited hy space-charge 
effects, then the space charge reduces the level of the shot noise. In 
such cases, I” is less than |: 


7 ree | 1 
r 376 tO Te>- 
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Using (6,24), we can easily find the correlation function and spectral 
density 


oM\* 
(66> =P'e Ch) (7 5(t}, 


(6.26) 


wyM\? 
SLE; ] = 2x(w)} = ar*ec| : 
E 
of the random excitation &(f} appearing in the linearized equations 
(6.8). Just such equations were considered in Chap. 5, Sec. 2 [see 
(5.29)], where we found the amplitude correlation function (5.33), 
which, according to (5.38), is proportional to «(@po) in the case of small 
correlation time. Substituting (6.26) into (5.38), we obtain 
5 é = 2 ,—ewalt| 
eee (6.27) 
2 3 2 
o* =—eCh wom’. 
de 


This correlation function corresponds to the following spectral density 
for the amplitude fluctuations: 
4a7 ew, 


ew, + w 


Similarly, according to (5.43) and (6.26), the phase diffusion coefficient 


1S 
Zz 2 2 
Do = 40 eCI,) (“2") a 2(<.) Be. (6.29) 


Because of the small correlation time of the shot noise, the phase shift 
is of a diffusional character, and we do not take account of deviations 
from this behavior which occur during intervals of the order of the 
correlation time. 

Using (6.27), we can easily determine the amplitude fluctuations of 
the current in the inductive branch of the circuit, In fact, according to 
(4.18), these fluctuations have amplitude A, connected with A by the 
relation 


A 
via (6.30) 
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where I,=Ao/woM is the stalionary amplitude of oscillations of the 
current 
x 


w,M 
Therefore it follows from (6.27) that 


2 


Qr 
(5A, 6A;,) = ve eKh> woe tl, (6.31) 


It is also convenient to write (6.29) in terms of the stationavy aynpli- 
tude of the current in the inductive branch: 


2 


Dy = HeCT) = (6.32) 
14] 


The correlation time of the shot noise is much less than all other 
time constants of the system which are taken inlo account here. This 
has the fortunate consequence of allowing us to use the two-dimen- 
sional Fokker-Planck equation giving the change in time of the joint 
distribution of da and dg. In the case of linear equalions of motion, 
the Fokker-Planck equation leads lo a Gaussian distribution law. 
Thus we can regard da(t} and d(r} as Gaussian (normal) random 
processes, with zero means and correlation functions which have 
already been found. However, we must still find the cross-correlalion 
function of these two processes. Since the randam initial phase is 
uniformly distributed and is statistically independent of ¢(1). we find 
from (6.26) that 


(é sin @-E,cos 6) = 4$ (EE, Csin(h — @,) + sin(P 4- &,)> 


wyM\? 33 
= sr7e¢h> (2) 6(t) sin (p —e)—-9, (6.33) 
E 
where the term in sin (# +@,) vanishes because of the averaging over 
9, while the last expression, involving sin (@—@,), vanishes because 
of the properties of the delta function. It follows from (6.33), at least 
within the context of the first approximation (6.8). thal the amplitude 
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and phase fluctuations are statistically independent. In faci, multi- 
plying (5.30) by (5.40), averaging the result and using (6.33), we see 
that 5A(t) and d¢(f) are uncorrelated and hence independent, since 
their joint distribution is Gaussian. Complete information about the 
processes da(t} and dg(t} can be deduced from knowledge of their 
correlalion functions. Using the general rules of Chap. I.3, Sec. 1, we 
can write the joint distribution function of any number of random 
values da(t,}, da(ty), .--, dp (t1), Sp(to), --- for arbitrary ty, fo, ... For 
example, the two-dimensional probabilily density for da and 6a, 
(where t>0) is given by 


1 
ba.6 _ _ 9p 2emoty— 1/2 

w (da, 6a,} aaa e ) 

{ (5a)? = Je tor ba da, (ea) ( 34) 

MER SS as =2iwer , 
20; (1 —e *") 
where 
» o FeKI,> ag 
a =-3 = (6.35) 


Next we find the correlation function and spectral densily of the 
generaled signal, by which we mean the current 


f= f.+ ooh = a 
or the grid voltage 
x 
U, = as : 
or even the voltage 
L L 
U, = uM U, = oo x 


across the inductive branch of the circuil. Since all these quantities are 
Proportional to x(t} or to its derivative, it is sufficient to find the 
correlalion function and spectral density of x(1) itself. Using (6.17) and 
bearing in mind that the amplitude and phase fluctuations are 
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independent while (da) =0, we find tnat 


(xx) 
Ag 


= (1 + da 5a,) (cos &* cos HT) 
E - oe * 
uy <cos &" (2¢ cos 207 + sin 36*)> 
7 <(2e cos 26" + sin 36") cos B75 


2 
+ (5) (29 cos 26" + sin 36*)(20 cos 27 + sin IP) . 
(6.36) 


Transforming the products of sines and cosines in (6.36) into sums and 
differences, we average the result over the random inilial phase @o 
appearing in @* —wof + og +d¢g. This causes certain lerms lo drop out, 
leaving 


ae = 30 + (5a 5a,)) cos (* — &*) + Hey cos 2(p* — o*) 
Lyfe \* s im 
if s(5,) cos 3(o" — 6"). (6.37) 
Since 


@* — $* =agt + 9, — dy = ont + AQ, 
(6.37) becomes 


c Xe J G font a : tig imot 
=< =5 Re (0 + (da da,>) Ce dey gloor 4 es fe’ ye? 
Fe ? Jide sa 
(;.) a ea = 


The ayerages 


<e'4%5 : (e7!4es : Ke? 4¢y 


appearing in (6.38) can easily be expressed in terms of lhe characteristic 
function of the phase shift, which Is of the forin 


¢eit4ry es eH Poltl (6.39) 
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since Ag is a Gaussian random variable with variance given by (5.42) 
and (5.43), Setting u=1, 2, 3 in (6.39) and using (6.27), we find that 
(6.38) becomes 


A 
(xx,) = ale +a? ge” tmwolely 9~ +Polr| COS Wot 


vA 2 
£Q - T f =3 = 
+ a) e 2Paltl cos Qurgt + (;5) e 2Paltl cog 3a | (6.40) 


Once we know the correlation function, it is an easy matter to find 
ihe spectral density, by laking the Fourier transform. The spectral 
density of the correlation function 


o* el cos aot 


has already been calculated in Chap. 1.2, Sec. 1. Using formula (1.2.24) 
and neglecting the quantity Dy in the second term, compared to e@, 
we obtain 


Dg EW p 


2 . 2 
Ape boel= Gray + De 7 ayy + Fah 
E0\? 4D, e \? 9Dy 
i) Gagner) Gaia ae 
(6.41) 


Because of the condilions e<1, Dy <wg, the spectral density has the 
line structure shown schematically in Figure 18. In studying the 
spectral densily, we must have an idea of how good an approximation 
il is to write D<ew,. In the example considered here, we have 
e~5x 1077, Dofwp~3x 1071? [ef. (5.43) and (6.5)]. 

Most of the signal power falls into the spectral band lying near the 
fundamental frequency wy. Approximately (€/24)? less power falls 
into the narrow bands lying near the multiple frequencies 2wpy and 3wp. 
Even less power is associaled with the higher harmonics, bul to find 
this power, we must carry out calculations to higher orders ine. 
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Wy 2Wo SW ww 


Fig. 18. Spectral structure of the generated signal. 


Examining (6.41) in more delail, we see (hat the spectral density near 
the fundamental frequency contains {wo components. Whe lirst term 
in (6.41) describes a narrow-band component, of total power 43/2, 
which is characlerislic of the self-exciled oscillations and has zero 
width in the absence of noise. However, because of the phase diffusion, 
this discrete line is spread out over a bandwidth of order 2,. The 
second term in (6.41) describes a component which is more broad- 
band, corresponding to the dashed curve in Figure 18; this component, 
of bandwidth ew, is due to the amplitude fluctuations. and ils power 


a 4 WAG 
yom Hedley os 
is less than that of the discrete line corresponding to the fundamental 
frequency. As for the last two terms in (6.41), they describe (he extent 
to which the discrete lines at the frequencies 2u)9, 30, are spread out. 
There are also broad-band components at these higher frequencies, 
but we omit them since they contain even less power. 

The spectral densities of the current I(t} and of the voltages U, and 
U, (see p. 158) are expressed in terms of S[.x;«] by the obvious 
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formulas 
SlI—(yia] = (32) Shee, 
S[U,:0] = (=) S[x;0], (6.42) 


S[U,;0] = (i) (=) S[x:o]. 


The spectral densities of the voltages U, and U,, obtained by differenti- 
ating x, differ by having a weak uniform Spectral component, i.e., a 
“white noise component.’ Although the spectral density of this com- 
ponent is small [equal to (Aj/2a9)?(Dp + 2atew, +e*Do +...}], it leads 
to a large (in our approximation, infinite) variance of the voltage 
fluctuations. To determine the actual size of the variance, we would 
have to make a more detailed analysis, taking account of the transit 
time or of parasitic integrating parameters in the circuit. 


3. Periodic Nonstationarity of Shot Noise 


Since the intensity of shot noise is proportional to the anode current 
which changes during a period of the oscillations, the noise intensity 
also varies periodically. Therefore shot noise is actually a nonstation- 
ary process. This nonstationarity can be neglected when the ac 
component of the anode current is much smaller than its d-c com- 
ponent, and then we can use the results of the preceding section, 
However, in many practical cases, the self-excited oscillations are 
quite large, so that it ts not permissible to neglect the a-c component 
of the anode current. For example, in the case considered in Chap. 4, 
Sec. 2, the anode current has a pronounced pulsating character, 
causing the size of the anode current and hence the intensity of the 
shot noise to change by more thana [actor of 60 during a single period. 
Under such conditions, it is natural to expect that taking account of the 
pulsating character of the noise, i.e., of the periodic changes of its 
intensity, will lead to appreciable changes in the results found in the 
preceding chapter. 
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First we note that formulas (6.18)-(6.25) remain valid even when the 
average current (1,(#)> and the number of electrons in transit n(1) 
vary with ¢, but then the anode current correlation function (6.24) 
depends not only on the time difference 1—1’, but also explicitly on 4, 
since ¢J,(1)> depends on 1. Neglecting the effect of transit time, we can 
express the average anode current (4.9) as a trigonometric series 


(L(t) = F| 4 cos (o +3)| = ig + i, Cos ¢ + ) 
tT v4 
+ i, cos a(@ +3) + i, cos a + ) +.... (6.43) 


since the grid voltage is U,~—Asin®. In the case where the tube 
characteristic is approximated by the polynomial (4.22), the coef- 
ficients of the series (6.43) are 


eg ae i= SA—2 43, 
4 4 
(6.44) 


= Ea, i,=—-—A*, ig=...=0. 


Since the fluctuational deviations from Ao, the stationary amplitude of 
the grid voltage, are small (a—1 <1), we can write 


ae +E a3, iy = SAy—7Ad. 
B a (6.45) 
Y 43 - 
1,=-AZ, i,=2-—Al, ig=...=0. 
2 4 0 3 12 o 4 


We now calculate the correlation functions of the random processes 
tae ings ces oh 
=—-—g¢sin = -—- COs tan i 
Ay Ip 2 


(6.46) 


t are Pp a 4 nt 
=—— fcos?=—-*sin - |, 
ee i 2 
Unlike the stationary case considered previously. the fluctuations of 
anode current are no longer independent of the phase of the oscil- 


lations, and hence formula (5.32) is no longer valid. Thus we must 
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average the product /,sin®/,,sin®,, say, in two Stages, first over the 
shot noise fluctuations (this does not affect the factors sin@, sin ®,) and 
then over the phase of the oscillations. This “double average” can be 
written in the form 


COib1> = Io 7 Cyl p> sin & sin ®,), (6.47) 
But the inner average over the shot noise Auctuations, which does not 
affect the phase of the oscillations, is just the average giving the corre- 
lation function (6.24), and hence 

(01012) = FP? ely 78(2)<¢1,(1)) sin? &> (6.48) 
(here we neglect any time dependence of the space-charge smoothing 
factor £*). Substitution of (6.43) into (6.48) gives 


C010 = Wel” 
x (Cio + i, cos ®’ + i, cos 2h’ + i, cos3@'})(1 + cos 26')y , 
(6.49) 
where 


C'=h4- 
04% 


When we average over the phase, the only surviying ayerage containing 
trigonometric functions is <cos*2@’)=}, since the initial phase is 
assumed to be uniformly distributed. Thus (6.49) reduces to 


i 
catia = a0 ele *(io + 2) (0) (6.0) 
Similarly, it is easily verified that 


Ctata> = HW ely” (1 = “oe, 


(6.51) 
Cite =O. 
In the particular case (6.45), these formulas give 
C001.) = WP? ely 7 + 4849) (ct), 6.52) 


Cabae> = HL? ely * (I. + 4BAD) O(c). 
Thus we see that the periodic nonstationarity of the shot noise 
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affects the amplitude and phase differently. In fact, the inlensily of the 
fluctuations acting on the amplitude is increased while that of the 
fluctuations acting on the phase is decreased (for # >0). The rest of the 
argument is the same as before, and is based on the cqualions 


Od + £W,da = Wel, , 
i 6.53 
AD = Wl. ( ) 


The increased intensity of the Auctuations acting on the amplitude 
causes the amplitude fluctuations 


Pe i Cy 
é 2 = i = par 6.54 
<(da)°> tle) a (6.54) 
to be increased | +(/,/2/.) times compared with (6.27). At the same 
time, the phase diflusion becomes less intense. and the diMuston coel- 
ficient in (6.32) becomes 
: 2 
. £2) 
Dy =4Fe{ ig — = : 6.55 
om artel fo 2) (6.55) 
Correspondingly, (6.54) and (6.55) lead to changes in the spectral 
density of the generated signal: The width of the discrete spectral line 
is diminished by (50i,/i9)%, but its intensity remains unchanged. On 
the other hand, the width ew, of the broad spectral component due to 
the amplitude fluctuations does not change. but its intensity is in- 
creased (50/2 /79)%. 
In the example considered above, we have 


A=Ilv, [. =0046a, f=I8 x 1lO™*a/e’. 


and hence, according to (6.45), the changes just descrifed amount to 
about 5%. Then the effect of the fluctuations on the amphtude will be 
about 10% greater than their effect on the phase. 

The analysis just given shows that the size of the effect produced by 
the nonstationarity of the shot noise is characteristicully determined 
not by the first harmonic of the oscillations of the anode current but 
by the second harmonic. 


3 This can be seen by setting <fa> = /'o in (6.27). 
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4. Influence of Amplitude Fluctuations on Phase Diffusion 


Equation (4.20) describing the operation of a vacuum-tube oscillator 
within the context of the present idealization leads to the equations 
(6.8) for the first approximation, according to which the amplitude 
fluctuations do not affect the phase at all. The effect of the amplitude 
fluctuations on the phase enters only in the second approximation 
(6.15) and is therefore small. However, in some cases the amplitude 
fluctuations can have an appreciable effecl on the phase fluclualions, 
for reasons nol laken into consideralion in (the derivalion of (4.20), 
e.g., because of the presence of grid currents. Hence il is of interest to 
invesligale (his phenomenon further. We shall do so by starting [rom 
the following linearized equalion for the phase devialion: 


; EM Eo 
6g =— — ydA—-— — C(). 6.56 
ane re C(t) (6.56) 
Here ((1)}= E(#)sin(@,t + go) is (he random process figuring in (4.67) or 
(6.16), which alter “simplification” has the correlalion function 
K(@ 
col) -“o 5(z) 


[cf. (4.68}]. The coefficient y describes the extent lo which the ampli- 
lude influences (he phase, and equals 


y= 4 +40) (6.57) 


in the case where (6.15) holds, [n the linearized approximalion, (the 
amplilude Auctualions constitule a Gaussian randoin process, which is 
independent of ((#} and has the correlation funclion (5.38). If we 
neglect the difference between w, and Wp, (5.38) lakes the form 


(6A 6A,) = a7 e tO0ltl (6.58) 
where 
a = fearon (Wo). 


Integrating (6.56), we oblain the following expression for the phase 
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increment afler the time 7: 
T T 


EW EWy . 
Ag = — —y|5A dt —-— Jat. 6.59 
9 A, | | (6.59) 
0 


Then, taking account of (6.58), we find the cxpression 


TT 
((Ag)?> = (=) [af [eamsacry dt dt’ 
0.690 
TT 


+ | CE(NE(N) dt at! 
0 0 


1 (em 9\? J 1-eo" 
=-(— T —-—-—.---]+T 
sae ros ( bw, 


for the variance ((4q)*5, while the cross correlation (4.44) is 


(5AA@)> = (6Ap4Q) = K(T), 
T 


(6.60) 


2 
k(T)= Poy | (BA 6A) dr =— “ 7(1- en toly, (6.61) 
04 é 


As the time increases until 7 >1/ew , formula (6.60) gives a purely 
diffusional law for the phase growth, i.e., 


<(49)"> = DT, 
where 
I /eag\" 
D, = Do(1 + 2y”)_ | Do==l-—) Ko) (6.62) 
2\ Ao 
is the corrected diflusion coefficient, which takes account of the effect 
of the amplitude fluctuations. At the same time, the correlation (6.61) 
approaches the limiting value 


oy 
(5A by) = (6Az dQ) = — oF ee 


i) 


(6.63) 


The correlation between the amplitude and the phase leads to a 
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certain modification of the correlation funclion 
x = Re(A e'*'*'*) = Re(ze*”) 


of the generated signal. In the present case, using formulas (1.7.16) and 
(1.7.73) instead of (1.7.76), we have 


(xx, = $Re(<(AA, e “4% @ '") 
or 


(xx,) = $Re {((Ap + AgdA + AgdA, + bAGA, JC 4%S e719") (6,64) 
The mean value on the right can be calculated from the formula 


((Ay 6A + Ay 6A, + 5A 5A) e779 


A : +A : 7 ro (6.65) 
~ i du a év Cu dv (4,2, ”) she sae : 
w=-t! 
in terms of the characteristic function 
O(u, v, w) ins Comper eens : 

which, according to (1.31), has the form 
O(u, v, w) = exp {— 4 [u? ((5A)*> + 2uv<5A 5A, + 07 (5A,)*) 

+ 2uwk(t) + 2owk(t) + w? (Agy*d}. (6.66) 
Substitution of (6.66) into (6.65) gives 


(Ap + 5A)(Ap + 54,074” 

= [Ag — 2¢Agk(t) — k?(t) + (6A A Je” AP? , 
[1 then follows from (6.64) that 

(xx,) = [A432 + (64 5A) — kK? (z)] 0 4)? cos wot 
~ 2Agk(t)e7 S47? SiN @pt. (6.67) 

Comparing this expression with formula (I.7.4), we define the func- 
tions 
r(t) = [Ag + (04 5A.) — k7(t)] oP? & [AG + (5A 5A Je P??, 
s(t) = 2Agk(t)e P77, (6.68) 


whose Fourier transforms then determine the spectral density S [x; w| 
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of the generated signal, as shown by forinula (1.7.8). The nogzero odd 
function s(t} now introduces an asymmetry into the form of the spec- 
tral density. Using (1.7.6), (6.61) and (6.68) and the sinallness of the 
variance Dg [or t ~£a9, we find that 


a(Q) =— 2im { e'™ s(n)dt 


= 407y[m | eg PZ Far ty (6.69) 


1] 
re Q Q 
=— 4a -—- — oe >): 
i Q?+4D? OQ? + c7we? 
Thus, according to (I.7.8), the effect of the amplitude fMuctiations on 


the phase is to add the asymmetric [unction 
\ J 


ae ee ete 
ws do* _—— a Wo é oO aS 
“(co - @g)* + }D7 (eo — wep 4 "we 


to the spectral density of the generated signal. In other words, the 
symmetry of the spectral line of the oscillation is destroyed by the 
presence of correlation between the amplitude and thc phase. 


CHAPTER 7 


Effect of Strong 
External Noise on an Oscillator 


We now examine the operation of a vacuum-tube oscillator under 
the action of fluctuating external voltages of high intensity. In practice, 
such voltages are sometimes due to unwanted noise, but in some cases 
they are deliberately applied to the oscillator for specific purposes, for 
example, to obtain oscillations modulated by noise. In Chap, 4 we 
derived equation (4.13) describing the operation of a vacuum-tube 
oscillator when the external voltages are applied 1) to the grid or the 
anode, and 2) tothe inductive branch of the tank circuit (see Figure 14). 
It is clear from (4.13) that in the first case, the external voltage appears 
in the argument of the nonlinear function F, while in the second case, 
the external voltage appears as a separate additive term. This difference 
leads to corresponding differences both in the mathematical treatment 
of the problem and in the analytical results obtained. Thus, in what 
follows, we shall consider each case separately. 


1. Phase Fluctuations due to Noise Applied to the 
Inductive Branch 


We begin by examining the case where the external noise is applied 
to the inductive branch. Neglecting the reaction of the anode load 
(i.c., setting D=0), we write (4.13) as 


I+ wel = w3 [F (MN — RCI] + w6Ca,. (7.1) 
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Then the variable x=w,M(I—I.), which has the dimensions of a 
voltage and is proportional to the a-c component of the current J, 
satisfies the equation 


. 2 3 x x 3 . 
x + Mgr = Do | Mr (=) = RC - | 4- woalfCr, . (7.2) 
where 


Fy(u) = F(u) — I. = Sut+ B = Ty, 
2 3 
in terms of the usual approximation of the tube characteristic (see 


Figure 15). Here the term fu?/2 does not affect the simplified equa- 
tions in the first approximation, and hence can be omitted. Writing 


at (I) = @MCi,, (7.3) 
so that 


MC\? 
K(a) = (2) wo’ S[ty; 0), 
3 
we can reduce equation (7.2) to the same form as equation (4.24), 
already considered in Chaps. 4 and 5. 


As shown in Chap. 4, simplification of the equations in standard 
form determining the amplitude A and phase ¢ of the generated signal 


x= Acos®=aAygcos(Wot+) (x =— A sin #) 


leads to equation (4.80), or to 
(7.4) 


in the first approximation. Here 4’ (ft) and [’(1) are identically distrib- 
uted independent Gaussian random processes, with zero means and 
correlation functions 


EM g : 
nnn = CD = = cd (t), (7.5) 
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where, according to (4.79) and (7.3), 


EWoK (Wo) «Wo ; 
c= AD = 22 S [u,; Wo | (7.6) 


(U,=LA,/M is the amplitude of the voltage oscillations across the 
inductance), Here the coefficient c is comparable to 1, since in this 
chapter we assume that the noise intensity is high. 

In Chap. 5, Sec. | we considered the amplitude fluctuations de- 
scribed by the first of the equations (7.4). It was found that the 
slalionary amplitude distribution is given by (5.8) and has the form 
shown in Figure 16. We also calculated the moments <a") of various 
orders, starting from <a~'>. However, the phase fluctuations de- 
scribed by the second of the equations (7.4) were not considered. We 
now turn our allention to this problem. 

To find the size of the random phase shift dg which occurs during 
the interval from fy to {9 +1, we integrate the equation g=C'/a, ob- 
taining 

fot 

o(t) 
p= a(t) dt. (7.7) 

fo 
Here a(r), like ¢’(7), is a random function, but is not delta-correlated. 
It is important to nole that a(f) is statistically independent of ¢'(t), 
being completely determined by the independent random function C’(£) 
[see the first of (he equations (7.4)]. We are interested in calculating 
the probability density (A) of the phase shift dg. Setting 45 =0 and 
using formula (1.1.8), we can write w(dg) as an average of a delta 
function: 


re’ (t) 
w() = (6(¥ — 49)) = (3(¥ la a) (7.8) 


The average in (7.8) will be carried out in two stages, by using the [act 
that a(t) and C’(f) are independent. First, for a fixed realization a(t), 
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we average over the ensemble of functions ¢'(7), obtaining the con- 
ditional probability density 


t 


w[¥la(t)] = (3 (v - [- 3 ‘t)) (7.9) 


a 


Then we regard a(t) as a random function rather than as a fixed 
function. This makes (7.9) itself random, and to obtain the trne 
probability density (7.8), we must still average (7.9) over all possible 
realizations of the process a(t): 


w(¥) = Cw(wla(O)>. (7.10) 


Since (’(f) is a Gaussian random function, the integral {(£'/a) dt is also 
Gaussian for any fixed a(t). Taking account of the delta-function shape 
of the correlation function of 2’, we find the conditional variance 


tt 


<(A~)>eised a(t) — | 


cs] 


CC (t)e'(#')> 1 Ey dt 
“atpa(ry dt = 5 «(iy (7.11) 
Q Q 


This variance (together with the zero mean value) uniquely deterinines 
the Gaussian probability density 


ae iP yo] 
wll a(o] = nevee ( (re) exp) — - i ay be (TA) 
i) TW ol 2 
af in) 


and all that remains is to carry out the average over a(1), as described 
by (7.10). 

It should be noted that under stationary conditions, the phrase shift 
of the generated signal has infinite variance. Infact. after averaging (he 
conditional variance (7.11) over a(t), we obtain 


<(Ag)*> = See | ca Moat ="Sfeda*>t, (7.13) 
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since (a-7(t)> does not depend on ¢. But it follows from the distri- 
bution (5.8) that (a~7) is infinite, since the integral 


@m 
gta 2 [gone 
N a 
0 


diverges at the lower limit a=0. This particularly strong influence of 
the small amplitude fluctuations on the phase difference has the 
following explanation: An appreciable diminution in the amplitude of 
the oscillations occurs relatively often, i.e., the self-excited oscillations 
stop almost completely and then start up again, but these inherently 
“new” oscillations have a phase which is only very weakly related to 
that of the ‘‘old” oscillations. Naturally, this lack of “‘phase conti- 
nuity” (which becomes more pronounced as the amplitude [alls to 
lower levels) enhances the amount of phase diffusion. If measures are 
taken to prevent the amplitude [rom [falling to the zero level, then the 
phase shift will have finite variance. Note that instead of using the 
variance, we can characterize the scatter of Ag by the average absolute 
value <|Ag|>, which has the finite value 


t 


ew c\"/? dt \i/? 
cl4ol> =( ~) (|e) ) (7.14) 


Qa 


Since a(t) is a complicated random process, it is a difficult matter to 
carry out calculations based on formulas (7.12), (7.10) and (7.14) in 
their general form. Therefore we confine ourselves to the case of small 
time intervals t, i.e., time intervals during which the value of the 
amplitude does not manage to change very much. Although greater 
accuracy is actually possible, we shall use the very simple approxi- 
mation 


Lee 715 
laq* ane Ce) 


obtained by assuming that the amplitude remains constant during the 
interval t, Substitution of (7.15) into (7.12), (7.10) and (7.14) gives the 
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wy) = (ncewgt)*!? (« exp \- v “th : (7.16) 


CE(WUgT 


\ 12 
(\49|> = (= <a7'y, (7.17) 


involving averages of the instantaneous values of the amplitude. To 
evaluate the expressions (7.16) and (7.17), we need only know the 
probability density (5.8). Thus for w(y) we obtain the expression 


2 ‘ at @ 3 
w(W) = ——~=_==e 16 emp} 5-4 
0 


N ./ nCe@gt 


a 


- hada. (7.18) 
C CEO) gt 


which can be written in the form 


2 
EW gt 
w= N, Z, eres (7.19) 


in terms of the normalization constant 


N, = N (8c)~'/4 (newt)!? e!!?¢ 


and the function Z,(y) introduced in formula (5.16). The function 
(5.16) can be expressed in terms of cylinder functions by using (5.18). 
Then the asymptotic formulas for the cylinder functions imply that 
J -3;2 


T 
aww 


Z,0) = \6 


for large values of y. It follows that 


1 fn 

w(y) a ra Ym gop (argt)”!? (Ww? — ewgt) *? ~ const wy". (7.20) 
2 

Thus we see that the probability density w(W) falls off slowly as w 

increases, so that the integral 


(Av)*> = { yw y) ay 
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actually diverges, unlike the integral 

<I> = [Ww (wyay. 
In Figure 19 we plot the curves corresponding to the function (7,19) 


for the values c=4, 4 and 2. It is apparent from the above consider- 
ations that for high intensity noise, the process of phase diffusion is 


0.5 


@) ———L____| igs, 


O05 | 15 Zz 
Fig. 19. Probabiliry density of the phase shifi 49 for various noise levels 
(z = dg/V eor). 


drastically different from an ordinary diffusion process, since the 
diffusion coefficient is formally infimte (D=oo) and the distribution 
law (7.19) is non-Gaussian. 

A problem of great interest is to calculate the correlation function 
and spectral density of the signal 


x = A cos (Wot + ~) = Ag Re (ae'”*’), 


According to (1.7.16), the correlation function can be written as 


Az 
(xx, = a Re {(aa, e7 4%) e "}, 


Substituting (7.7) into this expression, we proceed as before, averaging 
over the statistical ensemble of functions ¢’. After using (7.11), this 
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gives 
i¢e 


>= Ag aa, ex a dl Is (7.21 
XX _ a,¢ - EM5t = - COS MT. . 
(XX, 5 p at Zu) C ) 


For small t, when a, diflers only slightly [rom a, allowing us to use 
(7.15), we can write (7.21) in the form 


Ag 
(xx, & ) Ca? ea orld/4e’y cos wat, (7.22) 


where the sign <---> denotes avetaging with respect to the weight (5.8). 
Expanding exp{—q@gc|t|/4a?} in a Taylor series, we find the size of the 
“corner” of the correlation function (7.21) at the origin: 


Ae EM C 
(xX, =: Ke _ Gel + R,| COS ),T. (7.23) 


The remainder, denoted by R,, no longer has corners, i.e., its derivative 
with respect to t iS continuous, The size of the corner in the correlation 
function determines the spectral compouents which fall off most 
slowly as the frequency increases, allowing us to derive un is) mptotic 
formula for the spectral density S[x; w]. 
When the noise is weak (c <1), we can use the linear approximation, 
setting a=a,=| in (7.21). This gives 
Az 


O . —emgel r{ 74 


{xx = Pi e COS WoT, (7.24) 
which resembles the main contribution to the correlation function 
(6.40) found earlier, In this approximation, an ordinury dilTusion 
process takes place, with diffusion coefficient 

ED 


ps = 
2 
[see (5.43) ], which determines the width of the spectral line generated 
by the signal, since the correlation function (7.24) corresponds to the 
spectral density 
As EM GC 


Sets 4 (o— Wo)? + (fea@ee)?” 
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For |@—@,| > ew c we have the asymptotic formula 
Ad EWM gC 
S[x:o@| 2 — ——_, 7.2 
[ 3 | 4 (@ rn @)*” ( 5) 


corresponding to the corner of the function (7.24) at the origin: 


Ae EMC 
(xx >= —|1- It| + Rz | cos wot. 
2 4 

But, according to (7.23), the function (7,21) has a corner (i.e., a dis- 
continuity in the derivative) of exactly the same size. Lt follows that 
(6.25) is valid for |w— | ewge even when the noise intensity is high 
(c~ 1), despite the fact that the phase diffusion coefficient is infinite. 
According to formula (1.2.24), the spectral density corresponding to 
(7.22) is 


2 


Stnal=7( 


EW,ca” 
1 :). 
a” (w — a)’ + (5 tone) 
4a 


which, as asserted, goes into the asymptotic expression (7.25) for 
frequencies |w—wo| > ewe. 

We conclude our discussion of the case where the noise is applied to 
the inductive branch of the tank circuit, by calculating the value of c 
for the example considered in Chap. 4. Sec, 2. Substituting 


11 x 0.16 
9=——— ~ 1000, £20.05 
0.18 
into (7.6), we obtain 
Wo 
cz —~S[u,;}. 
100002 > Ls 2] 


Thus, in calculating c, instead of the mean square value of the fluctu- 
ating voltage u,, one should think in terms of a conventional “‘equiva- 
lent” quantity, defined as 


Feq = (WS [uy5@])"”. (7.26) 


In our example, c is comparable to | if (7.26) is of order 30v. 
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2. Amplitude Fluctuations due to Noise Applied to the 
Grid Circuit 


In the case where the external voltage fluctuations act on the grid of 
the vacuum-tube oscillator, the random [unction is subjected to a non- 
linear transformation. In fact, setting u,=0, D=0, u, =1 in (4.14) and 
(4.15), we obtain 

I 4 ool = wo {F[MI + u(t]— RCI}. (7.27) 
Writing <=@,M(I—TJ.) as before, and using our previous approxi- 
mation (4.22) for the tube characteristic, we find that the oscillations 
are described by the equation 
; ; 2 
x : 
Xporx= alas (= + «) + aims (= + «) 
Wo 2\@o 
i ‘ (7.28) 
— wim 3( = + ‘) _ waRCr. 
3\a@o 
Although all the terms in the right-hand side of (7.28) must be small, 
we use the followingnotationinstead of introducing asmall parameter e: 


Go= ane (Si ou -1.'), 

gq, = (MS — RC) + wgM (Bu — su’), 
B 

qz2= aM (5 ’ 


y 
qy=— aM. 


(7.29) 


Then (7.28) takes the form 


248 : x xy x\3 
X + MX = Mo] Jo + 91 — +42) — J + 4al -- . (7.30) 
Do Do Og 


The equations in standard form (4.31) corresponding to (7.29) are 


Wo x x\? x\3 \" 
A=—|qo—-+4:1(| —] +942[—] +4 : 
A Do Do Do Mo, 

: Wy ‘ x - x\ <\ 
=—-,5 — — x 
? me qo 413, G2 aie + 4 a , 


(7.31) 
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where x 
x=Acos®, -—-=—Asin® (P=a ot +9). 
Wo 
It is convenient to go from powers and products of trigonometric 
functions to trigonometric functions of multiple angles. It is easily 
verified that 


@ 
= 2[ 4014? + asd* — qo sin & — 3q,A" sin & 


~ 2 cos 26 — ; si 
4q,A* cos 26 —4q,A° cos 26 + ...], (7.32) 


@ 
c— “2 [qo4 cos ® + 4q2A° cos & — $q,A’ sin 26 
— }q3A* sin 26 +...], 


where the dots denote similar terms containing sines and cosines of 
3@ and 4@, 

The fact that the random excitation u(t) undergoes a nonlinear 
transformation leads to the appearance of a large number of fluctu- 
ational terms in the standardized equations (7.32). This is to be 
contrasted with the earlier situation, where the standardized equations 
(4.36) contained the random function €(f) only in the combinations 
ésin® and cos, involving the sine and cosine of the fundamental 
frequency, so that only the spectral density «(@Q) of €(#) at the funda- 
mental frequency had an effect in the first approximation. Now the 
excitation u(f) appears in (7.32) in various combinations involving the 
trigonometric functions of frequency 0, wo, 29, Jw, and 4@ ,. For 
example, the expression $q, A? contains the term 4a, MfuA? involving 
no trigonometric function, the expression qgAsin@® contains (among 
others) a term @jMSusin® involving the sine of the fundamental 
frequency, the term 4q, A* cos2@ contains the product of Bu and a har- 
monic of twice the fundamental [requency, and so on. Therefore, toa 
first approximation, the generated signal is appreciably affected by the 
spectral density S[u;@] of the random excitation u(#) near the zero 
frequency and also near multiples of the fundamental frequency. The 
presence of terms of the type yu?, yu" sin@, etc, containing powers of the 
random [function u, causes the spectral density at other frequencies to 
have an effect as well. 
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Of course, the situation becomes simpler if the random excitation 
u(t) has a small bandwidth compared to the frequency o). ‘Then 
certain terms in (7.32) have only a slight effect. and the uunber of 
important terms becomes smaller. Thus we shalf consider the case 
where the spectral density of the excitation u(t) is appreciably dillerent 
from zero only in a comparatively narrow band Aj <i» lying in the 
region of small frequencies. This means that w(t) is slowly varying 
compared to the high-frequency oscillations, and hence changes ap- 
preciably only during a time t,,, which is much larger thai a period: 

2n 
Tor PO + 
Wo 
If we average the right-hand sides of (7.32) over a period. the terms 
with trigonometric functions drop out, since the coefficients multi- 
plying them (which depend on A and u) change only slightly during a 
period. In the first approximation, this gives the truncaled ¢quations 


@ 
A= SA +4434’), g=0. 


We now write the expression (7.29) for q, as a sum of ¢wo terms 


qi = 2p + 22 (t), (7.33) 
where 
2p = Wo (MS — RC) + woM <fu — yu’), (7.34) 


and C(t) is the random [unction 
M 
t= — [Bu — yu? — (fu — yu], (7.35) 


with mean zero and correlation function 


WoM 
2 


2 
(te -( ) es ees 


= (2M) eK Lud~ wKLW) 36 


_ pyK [u’,u,] +7°K [u7,u7]}. 


182 NONLINEAR SELF-EXCITED OSCILLATIONS [cH. 7 


Assuming that u is a stationary Gaussian process with correlation 
function 


(uu > = k(t) = 0 R(t) 
and mean zero, we have 
K[u,u,J=k(t), K[u,u%]=0. 
To calculate the expression 
K[w?,u7] = (uu) — <u*y’, 


we use formula (1.1.70), with 1;=(4,=6, (s=4=t4+t and k,=0, ob- 
taining 
(u7u’> = 2k? (t) + k? (0) = 20*R? (zt) + 0%. 


Therefore the correlation function (7.36) becomes 
@yM\" 
(l= (°S) o°[B'R(c) + 2y*e?R*(@)]. (7.37) 


With the notation (7.34) and (7.35), the equation describing the ampli- 
tude fluctuations takes the form 


A = WA (pt + $934") + WAL (1). (7.38) 
If the correlation time t,,, of the externally applied noise is less than 


the amplitude relaxation time, so that 


Teor es 3 
0 


then (7.38) can be solved by using the Fokker-Planck equation. Here 
we represent the random function ((f) as a delta-correlated process, 
replacing the correlation function (7.37) by 


{i0,) = Kd (t), 


with 
K= | Cl dt= (eS) Gi | R(t)dt + 29707 | R? (zt) ar| : 


(7.39) 
By the usual rules (see Chap. 1.4), the Fokker-Planck equation 
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corresponding to (7.38) is 


CA| CA cA 
(7.40) 


[cf. (1.4.161), 14.162) and (1.4.170)]. The stationary amplitude distri- 
bution is characterized by vanishing probability current: 


rs] A "A : 3 4 
W(A) = ~ = [woA (t+ 39547)w] + 1Koe : ; (AZ) + ee 


a aw 
WoA(u + #434") w ~ 1ko8| Sam) + A’ | =0. (7.41) 


Introducing the notation 
‘ 
= $ 43_ you h 


WK’ WK 
and integrating (7.41), we obtain the stationary distribution 


, (7.42) 


2A" 
w(A) = ——-- A?" 1 44" 7.43 
(Ay= pasate (7.43) 
plotted in Figure 20 [cf (1.4.49) and (1.4.171)]. 
It is apparent from (7,43) that the quantity A determines the scale 
along the A-axis, in the sense that the amplitude appears in the 


Fig. 20. Probability density of the amplitude for noise applied to the grid cicuit: 
I) Undeveloped oscillations ; IT) Partially developed oscillations ; 111) Fully developed 
oscillations. 
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expression for the element of probability dP in the combination 
Ay} A=B: 


2 
dP =w(A)dA=—- e°™ B?* "dB. 


However, the shape of the curve is determined by the quantity v, the 
ratio between p and an “equivalent noise variance” w,K. |n fact, using 
the form of the amplitude distribution curve, we can make the [ollow- 
ing qualitative characterization of the operating regime of the oscil- 
lator: 
1. If w<O(v<0O), there are no oscillations at all, at the point rep- 
resenting the value of the amplitude simply stays at the origin of 
coordinates, regardless of the size of the noise fluctuations. 
2. For small positive values of » such that 


O<p<bwoK, ie, O<ve<eh, 


the power 2v—1 of A in (7.43) is negative. However, despite the 
resulting infinite value of the probability density of the amplitude 
at the origin, the density remsins integrable, i.c., the probability of 
occurrence of sinall amplitudes is small. This is the case where the 
external noise is large compared to the “‘strength” of the lint cycle. 
In fact, the noise is so large that the self-excited oscillations are 
repeatedly thrown out of the stable cycle, preventing the generated 
oscillations from having any “predominant” amplitude. Then, as 
can be seen [rom Figure 20, the probability density is monotonic, i.e., 
the smaller the amplitude, the larger its probability. This might be 
called the regime of “‘undeveloped oscillations.” 

3. When the relative noise level becomes smaller, so that 


dug K <p<mgK, ie, f<v<l, 


the probability density is no longer a monotonic curve. In fact, in 
this case, there is a most probable value of the amplitude, equal to 


ae es 7,44) 
ON BAF Se 


but this maximum is not very pronounced (see Figure 20). In fact, 
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the amplitude of the oscillations is scattered over a wide bandwidth 
and can take values near zero with appreciable probability. This 
might be called the regime of “partially developed escillabens.” 

4. Finally let p> K(v>1), corresponding to an even smaller 
noise level or a more stable limit cycle. Then we live the most 
interesting case, i.e., the regime of “fully developed ascillatfons”’, 
where the representative point stays predominantly near the lint 
cycle. Then the scatter about the most probable value (7.44) plays a 
subordinate role, and becomes smaller and smaller us v is increased. 
Using (7.43), we can easily calculate the moments of the amplitude 

distribution, obtaining 


2M lites  TOIVE) 


marco Se eee og 7.45 
PO)J AX? F(x) ce) 


<A") 


The formulas for the even moments are particnlarly simple: 


v v+1)v r+i—1)}...0%4]1)v 
(ay 4, caty of ee me cary a & -- I Ce 
(7.46) 
The mean value of the amplitude is given by 
1 Fiov+4 
(ADS ECS 2) (7.47) 


which differs from the expression (7.44) for the most prabable value. 
Together, (7.46) and (7.47) give the variance 
1 r 2(p + }) 
DA = (A*) — (A? =~] v-— 3 7.48 
Using (7.45), we can immediately write the odd moments in terms of 
the first moment: 


v+4 
(A*y = "2 (Ay, CAS) = 


SNE <A>... (7.49) 


Thus we have expressed everything in terms of elementary functions 
except the mean value <A>. However, there is a simple approximate 
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formula suitable for large values of v. In fact, it is easily deduced from 
the well-known asymptotic representation of the gamma function that 


<A) = Pome + o(::)} (7.50) 


which, together with (7.48), implies 


1 1 
DA= al! +0 (3) (7.51) 


We conclude this section by making some numerical estimates, after 
establishing the relation between the parameters p, v and the previous 
quantities &, Ag. It follows from (4.25), (7.29) and (7.34) that 


Senn (eee ol 
=—- —-W)Myo* =-{1—4-5], 
B 570 Y it z 


2 A? 
3 l va E 
— — = -@ — 9% 
ge? ge 42 
and hence 
2 
& & o 
fix aS ee eae), 7.52 
2A2a9K sank <) eo? 


But, according to (7.39), 


K = (2053) [5 | R(t)dt +2 | R*(oae| 


where 


Substituting 
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20,K = 82 eV 3Y a4 5 
of =F Dolce 5.5 5 + ’ (7. 3) 


if t.,, Teo, For example, ife=0.1, wot,,,= 10, then 


55\7 
10 2) o 
vz 1O[ - -! ‘ 
o 3\? 
( +1 
o 
It follows that the regime of fully developed oscillalions is upset (v= 1) 


when the noise is increased much past the value o=5v. For values of 
o=5,5y and higher, the oscillations are completely extinguished. 


we oblain 


3. The Amplitude Correlation Function and the 
Spectral Density 


Having found the stationary amplitude distribution, we now study 
the time variations of the amplitude. Introducing the dimensionless 
time 

to = agKt, (7.54) 
we can write equation (7.38) describing the amplitude variations in the 
particularly simple form 


aA ; 
dt. = yA —AA + Aly (to), (7.55) 
a 


where €,=C/@,K is a random process with correlation function 


<Co (10) 50 (fa}> = (fa — fo) (7.56) 


Our problem is to find the amplitude correlation function ¢A(to}A (fo), 
or the quantity v, (fo — fg), in terms of the notation 


Uy (to — 19) = CA(tO)A* (ta) (kK = 1,2,...)- (7.57) 
We begin by differentiating ¢A(to}A(to)> with respect te ty. After 
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using (7.55), this gives 


dA +43 r 
(4 a) = y(A‘A>) — ACA’A) + (A’ACG), (7.58) 
ato 


where A’=A(t9). To calculate the last term, we must take account of 
the statistical dependence between A(to) and Co(fo). Because of the 
small correlation time of the process C,, the first term A_, of the sum 


does not depend on {)(f) even for small A < I /v, provided that 4>t,,,, 
and hence 


(A‘A_ bo> = (A'A_ 4) Eo). 
But this term vanishes, since €, has mean zero, and therefore 
(AAC) = CA'A_ glo + (A'AALG = CA’AAL >. 
Substituting into this equation the expression 
fo 


tp-A 


implied by (7.55), we obtain 
(A’ACa) = (A'A-, | Co (to) dte-tolt)). 
Io-d4 


Again using the independence of A_, and Cg(f,), we replace the aver- 
age on the right by a product of averages: 


(A'Alg) = (A‘Aqa) | (a(to)La(ts)) dt 
A 


Since A is much larger than the correlation time, the integral on the 
right is just half the intensity coefficient, i.e., 


to Qa 
| (o(te)Ca(t2)> at = | o(te)Co(t + 2) dt =4, 


to- 
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and hence 
C<A'ALS> = 4CA‘AD. (7.59) 
In writing (7.59), we have also used the fact that the diflerence A —A_, 
is small, because of the inequality 4<I/v. In the same way. we can 
easily prove the more general relation 
of 7 


¢A (to) F [A (to) Sa (t0)> = SAF (A) So = Alt) A(to)>. 


(7.60) 
which is approximate for a finite bnt small corrclatian tisne and exact 


for the delta-correlated process Co. 
Substituting (7.59) into (7.58), we obtain 


al BO = (v + $)02(t) — Avy (rt). (7.61) 
in the notation of (7.57). Similarly, because of (7.55). 


dA* 
(ae) = 3y<A'A*) -— 3A <A'A*S + X<A'A rep: : 
0 
or 
dv,g(t 

ark) = 3(v + Peg (t} — Arg (er). (7.62) 
after using (7.60). Continuation of this process involves funclions (7.57) 
of progressively higher orders, which in turn satisfy suitable equations 
like (7.61) and (7.62). As a result, we obtain an infinile chain of 
differential equations determining the functions (7.57}. with the obvi- 
ous initial conditions 


v,(0)=<A7>, v,(0) = ¢A*)...., (7.63) 


where the univariate moments <A’), (A*), ... have already been found 
[see (7.45) ]. This chain of equations can be solved hy various approxi- 
mation methods. One such method consists in truncating the chain, by 
considering only a finite number of Functions v,, ty, .... U2,, and Some- 
how expressing the function v,,,, appearing in the equation [or ry, 
in terms of functions with lower indices. It is best to express v5,4.. in 
terms of the function v,, whose behavior most closely resembles that of 


D242: 
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The following method of representing v,,,, in terms of v,., gives 
good results: As the time difference tg—fg is increased (tg— 7), 
each function v, turns into a product of moments: 

p, > CAD CANS, 
This suggests introducing the correlation coefficient 
0, — <A) CAE") 
<A*y eal CASA ss 
of A(tq) and A*~‘(t,), normalized in such a way as to equal unity when 
fo==to. The coefficients (7.64) are in general different for different 
values of k. However, it is intuitively clear that the way (7.64) depends 
on time cannot be very different for neighboring values of k, e.g., for 
k=2land k=2! +42. Thus, equating the coefficients (7.64) for k= 2/ and 
k=2!+2, we arrive at one method of expressing v,,,, in terms of 
v,, After truncating the chain of equations, the remaining system of 
equations (which are in fact linear) can be solved in the usual manner. 
Of course, the more equations are retained, the greater will be the 
accuracy of the resulting calculation of v2 (rt). 

We now use this method in its simplest version, retaining only one 
equation (7.61) and expressing v,(r)} in terms of v,(t). Equating corre- 
Jation coefficients 


va(t} — <A)<A®) _ 0 2(t) — CAD? 
<A*) — CA) <A*D (AD = CAD?’ 


and using the previous formulas for the moments 


(k = 1,2,...) (7.64) 


a ge ade 
(A*) = KA), CAt) = KAP), 


we obtain 
(v + 1} <A?) — (v + 4) CAD? <A?» <A>? 
= - —_ —___—_, 7.65 
v4 (t) ADA v(t} 2ADA ( ) 
With this approximation, (7.61) goes into the equation 
dv, (t) v,(t) — <A>? 
Oe ea (Ath 7.66 
dt 7 2DA ( ) 
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Fig. 21. Dependence of the amplitude correlation time ta on the noise intensity. 
The solution of (7.66), subject to the initial conditton (7.63). is 


A? 
v,(t} = <A>* + DA exp {- itt, 


or 
(AA,) = CA*¥ e444 CADA(L — 4, (7.67) 
where we return to ordinary time and introduce an anip/itinfe corre- 


lation time defined by 
1 2DA_ 2A 2 r(v + 

“(==> EE A eee ) ‘ (7.68) 
MK A Mott Mott rr () 

Figure 21 shows the dependence of the amplitude correlation time 
on the noise intensity divided by the “strength” of the limit cycle, 
ie., on the quantity 

1 @K 
ae 
The very fact that the correlation tine depends on the noise intensity 
is a typically nonlinear effect. As can be seen from the figure, an in- 
crease in the noise intensity leads to a decrease in the correlation time. 
For small intensities y> |, it follows from (7.68) and (7.51) that 
I 

Rs——, 7.69 

Ta Den, (7.69) 
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a reSult which can also be obtained by the linearization method. 

Equation (7.67) shows that in the present approximation, the ampli- 
tude fluctuations constitute an exponentially correlated random pro- 
cess with correlation function DA-e™!*!*4, corresponding to the spec- 
tral density 


4t, DA 

S[A- <A; o] =. —-5. 7.70 
[ (Ada 1 + w*t ee) 
It is also easy to wnite an expression for the spectral density of the 
generated signal x= A cos wof (in the case under consideration, the 
effect of phase fluctuations is negligible). After averaging over the 


random initial phase, we have 
{xxX,> = 4¢AA,) COS Wet, (7.71) 
or, because of (7.67), 
<xx,) = $[¢A>? + DA-e7!"!*4] cos wot. (7.72) 


Since t, > 27/w 9, the corresponding spectral density is 
lew caer es A. 
S[x;@] x 2¢A* d(@ @q) + | Foe (7.73) 
[ef. (1.2.23) and (1.2.24) ]. 

A characteristic feature of the present problem, in which relatively 
slow noise fluctuations are introduced into the grid circuit (where they 
are subjected to a nonlinear transformation) is that the amplitude 
fluctuations greatly exceed the phase fluctuations. This accounts for 
the presence of the sharp line in the spectral density (7.73), in addition 
to the band due to the amplitude fluctuations. 


CHAPTER 8 


Effect of Slowly Varying 
Ambient Noise on an Oscillator 


As we saw in Chap. 6, the shot noise and thermal noise invariably 
present in every oscillator circuit cause only slight fluctuations in the 
amplitude and phase of the generated signal. However. there are other 
factors impeding the operating of an oscillator which produce much 
preater frequency changes, and these must be taken into account in 
any Study of oscillator instability. Such factors include changes in the 
circuit parameters due (0 various causes, like teniperature fluctuations 
and mechanical shock. For example, temperature changes can produce 
corresponding changes in the Capacitance and inductance of the tank 
circuit, or in the cathode emission. Moreover, lack of constancy of the 
supply voltage may play an important role, there may be further 
instability in the cathode emission due to the flicker effect. aud so on. 
The totality of all such spurious factors, which produce larger ampli- 
tude and phase fluctuations than the “internal noise” discussed in 
Chap. 7, will be called “ambient noise.” Ambient noise is character- 
istically more slowly varying than Internal noise, and it ts because of 
this qualitative difference that internal noise is not completely masked 
by the stronger ambient noise. 

The slowly varying character of ambient noise allows us to apply the 
quasi-static method of Chap. 5, Sec. 3. Let (rf) be the random 
function describing the fluctuations of some circuit parameter. Then 
the operation of the oscillator is described by the equations 

A=sG(4,f), g=cH(A,é) (8.1) 
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[cf. (4.33) and (5.46)]. It will always be assumed that the correlation 
time of the fluctuations is much greater than the relaxation time, i.e., 


1 
Teor P+ (8.2) 
EW 
Therefore, for every value of &(f), a corresponding ‘‘quasi-stable” 
value of the amplitude manages to be established. This value 


A()= ALE(O] (8.3) 
can be determined from the equation 
GLA), E()] = 0. 


Thus the dependence of A(t} on E(t) reduces to a zero-memory trans- 
formation. Moreover, according to the second of the equations (8.1), 
the frequency is also a zero-memory transformation of €(f)}: 


g=O2(E), 2(0) = cH[A(Z).¢]. (8.4) 


The parameter instability permitted in practical oscillator circuits 
must never produce more than a small amount of amplitude scatter. 


Therefore the condition 
<(5A)*) < AG (8.5) 


is always an underlying practical requirement, justifying the use of the 
linearization method of Chap. 5, Sec. 2. This makes the problem of 
studying ambient noise even simpler. 

Let o, denote the standard deviation of the frequency fluctuations. 
Then, before starting our detailed study of ambient noise, it is worth 
pointing out that a key role will be played by whether the quantity 
Solo, is large or Small compared to unity. 

In this chapter, we shall consider only two kinds of ambient noise, 
ie., flicker noise and fluctuations in anode voltage. Although these 
may not be the most important causes of oscillator instability in every 
case, they do exhibit all the characteristic features of ambient noise in 
general. Accordingly, the methods used below, together with the 
accompanying qualitative conclusions, are for the most part still valid 
when dealing with other kinds of ambient noise. 
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1. Self-Excited Oscillations in the Presence of Fluctuations of 
Anode Voltage 


If the anode voltage is unstable, we can imagine that a variable 
voltage u,(f} is Introduced into the anode circuit, as shown in Figure 
14. Setting all the other voltages equal to zero in (4.14) and (4.15), we 
obtain 

f+ ogl =ag{F[M'T + u()] - RC. (8.6) 
This equation is the same as (7.27) with M and u=1, replaced by 
M’=M-— DL and u,= Du,, but, of course, D can no longer be set equal 
to zero, since we want to examine the fluctuations of anode voltage, 
using formula (4.6) to approximate the characteristic (4.5). It follows 
from (8.6) that the oscillations of the coordinate x =«w,M'(I- I_) are 
described by the equation 


: . : x ee x \? 
X + MgX = Mo] do +d1— + 424 —- | + 4al- . (8.7) 
Wo Wq Do 


which coincides with (7.30). Here the coefficients g, are given by the 
previous formulas (7.29) with M replaced by M’‘. The cquations in 
standard form corresponding to (8.7) are given by (7.31), or more 
concisely by 


& @ 
A=——f(y,u)y = —(qoy +41)" + Gav? + a3"), 


€ @ 
al (ul)x = - Fi (fo + 41Y +423? + aay") *, 
a 


= - 


where y= X/a,. Using (8.7), we can write the second of the equations 
(8.8) in the form 
3 X — ef 


x — & ; 
a en, Se usp — 
aA we ora (ysu)) 


Pa 


wg A? 


g= S7(y,u). (8.9) 
If A and u were constant, the first term in the right-hand side of 
(8.9) would be the time derivative of the quantity 


f(4), 


2 
& 


242 
oA 
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where 
ar(y, 
ae y =f(y,u), (8.10) 
y 
i.€., 
ef (y,u)=ao(doy t tary? + 4aay? +4437"). (8.11) 


Because of the slow variation of the functions A(t) and u(#), this term 
does not equal the exact time derivative, but involves additional small 
corrections: 
df e« of 2s 
Bh ics ru ed ru = j 
rar 0 ys ilaeelo | 


gE 
u+ 
wed? du = weA? 


fA. 


Substituting this expression into (8.9), and using the first of the 
equations (8.8), we obtain 


d E e of e 2fy 
= ass a oo + -f |. 8.12 
AG i) weA* du om aw (a ) oe 


Together, equation (8.12) and the first of the equations (8.8) form 
an exact system, containing only one rapidly varying function y= 
— Asin(woft+q). Using the fact that A and wu change only slightly 
during a period, we can average over a period. Then the odd powers 
of the rapidly varying function y vanish, since they contain only 
oscillatory components, while even powers of y must be replaced by 
their nonoscillatory components: 


y>td*, y*a2d*, y® 55 A%, yP a BSeA®. (8.13) 
Thus the first of the equations (8.8) gives 
A = wy A(4q1 + $934”). (8.14) 


To transform (8.12), we begin with the terms of order ¢. Because of 
(8.11), we have 


ef > wo (44.4" + sand‘), (8.15) 
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where the expression on the right will be denoted simply by w347y. 
Then, using (8.13) to transform the expression f(/r4°?-f), we 
obtain 


. ox . 5 2 
@-=— 5h wo(agi + 5G24* + FxqGsA® + ead’). 
(8.16) 
Together, equations (8.14) and (8.16) are an example of the system 
(8.1), and are valid if t.,,> 1/a. If the condition (8.2) halds. corre- 
sponding to even slower fluctuations, then we can go over to the quast- 


stalic approximation. The appropriate equations are oblained by 
setting u=0 and A=0 in (8.14) and (8.16). Then (8.14) gives 


A? =— -—., (8.17) 


and substituting (8.17) into (8.16), we obtain 


l 2 43 
—— Se et de 8.18 
@ was 754 52) (8.18) 


To transform (8.18) further, we introduce the notation 


= 2+ 2¢, 
w . 7 MAT’ (8.19) 
w= > '(M'S— RC), f= 5 (bu — yu’), 


which closely resembles that of formulas (7.33) to (7.35), except that 
we do not center { about its mean value. The randoni [function ¢ has 
the same correlation function in both (7.35) and (8.19). If we substitute 
into (8.18) both (8.19) and the relations 


2 _ w)M'B 
: 2 


2 
— 2w_M yi 


Pa 
q3 = — @M" 5 
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[see (7.29) ], we find that 


g=—ay("4 o(* tet wm 'p +) 


4 (8.20) 


@ 
=~ [H+ Dn - 0), 
where 
4 — 
H,=E+ go vO B 
? 
At the same time, the expression (8.17) for the amplitude becomes 


APS 8: (8.21) 


It is clear from (8.21) that in the present case, the extra condition (8.5) 
that the amplitude scatter be small takes the form 


Kr) <n. (8.22) 


If (8.22) holds, then the right-hand side of (8.20) can be simplified by 
dropping quadratic terms, i.e., 


(Og 


¢= q Chu — Hy) E = @optf, (8.23) 
where 
1 
Hy = FEU oom’ s. 


Here we also drop the constant term — jw yp, which has no effect on 
the size of the fluctuations but merely represents a correction to the 
fundamental frequency of the oscillations. 

Equation (8.20) and the less exact equation (8.23) are concrete 
examples of (8.4), which when integrated gives the phase shift after 
time T: tp¥t 


4g= { Odt. (8.24) 


It is particularly easy to study the behavior of the phase if Q is a normal 
random process, 
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2. The Correlation Function and the Spectral Density of the 
Signal for Gaussian Frequency Fluctuations 


Suppose the fluctuations of anode voltage u, (and hence of w= Du, 
as well) are described by a Gaussian random process. with zero mean 
and correlation function 

<uu,> = 0 R(t). (8.25) 


Moreover, suppose the condition (8.22) holds, for which tlie following 
two conditions are certainly sufficient: 


w,M’'\? w,M’\? , 
( : ) Bot <i? (") yrot <0? 


‘a (8.26) 

(. =- (M'S — RC). 
Usually, the order of RC is less than that of M’S, so that A1‘S— RC~ 
M’S. After dropping RC, the first of the conditions (8.26) takes the 
form 


Bra* <S?’, 
Or 
fo <S. (8,27) 
Sometimes the inequality 
yo <B (8.28) 


also holds. This means that the quadratic component —1i)Af';1? of 
the process ¢ is much smaller than the linear component. which allows 
us to neglect the former and wnte 


WM’ 
C= . Bu. (8.29) 


But then the frequency 2 appearing in (8.4) and (8.24) is a Gaussian 
random process with correlation function 


(22,> =04R(t) (¢q = H@oM'f) (8.30) 


and mean zero. In this case, the various statistica] characteristics of 
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the amplitude and phase fluctuations can easily be calculated. In fact, 
according to (8.22) and (8.23), 


A=A,+ .-é, (8.31) 


and hence the amplitude, as well as the phase, is a Gaussian process. 

Having made these preliminary remarks, we now find the correlation 
function and spectral density of the generated signal Acos(wot+@), 
assuming that g=(t) is a stationary Gaussian random process. 
According to (8.5), the amplitude fluctuations make a negligible 
contribution to the broadening of the discrete spectral line, and hence 


xX = Ay cos (Wot +@) , 


fott 


<xx,> = 442 (cos (er + | ¢) ar) (8.32) 


fo 


where we have used (8.24), averaging over the random initial phase. 
The correlation function (8.32) can be expressed in terms of the 
characteristic function of the phase shift: 


<xx,) = 4A? Re jeer (exp (:f a))} (8.33) 


In fact, to write the characteristic function, we need only know the 
variance of the phase shift, which, according to (8.24) and (8.30) equals 


ao) = 08 [RQ —e)drar’ = 203 | (@—e)R(e) dr 
fo to .?) 


(8.34) 
Therefore 


Cxx,> = 4A2 exp = o’ | (e - t') R(t’) a COS WoT, (8.35) 
0 
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and the spectral density S[x; w] is then found by taking the Fourier 
transform of (8.35). 
Example 1. Suppose the correlation coefficient R(t) is of the form 


R(t) = tror(t? + Tre) 27. (8.36) 
Then 


<(4g)) = 208 | —7')R(t') dt’ = 2061,,, (/ ee ee 
0 


and hence 
<xx,) = 442 exp {agt2, — o8teor/t? + Te} COS ot. (8.37) 


Using the formula 


yide? 2 2b ay?) 
| ga tor~ evs +e ds = bie =Ki(qJ/r’ + mw). (8.38) 
/P +o” 


we find the Fourier transform (1.7.6) of the expression 
r(t)= 4Aé exp {o2x2,, - Cota ft? +12, — iwgt}. (8.39) 


whose spectral density at positive frequencies, according to (1.7.8), is 
practically the same as the desired spectral density of (8.37). As a 


result, we have 


22 
TOT eg, 


S[x:@ = A? PEN eee . —--—-— SO 
nee J ont, +(@ — Wo)? (8.40) 
x K, [Teorr/o872,, + (w ~ wo)" | : 


Example 2. Suppose the frequency is an exponentially correlated 
process with correlation function 


J 
£22, = og elt = Ap? eg Altl (n- ), (8.41) 
Teor 
where S=1/t,,,. Then, according to (8.35), 
(xx, =4AZ exp{—A(Pr—1 +e *)}coswot (tr >). (8.42) 


To find the spectral density S[x;@], we first calculate the Fourier 
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transform (1.7.6): 


e(w) = A3 | exp{- A(pr — 1 +e *")} cos wt dt 
e (8.43) 


= Az Re | exp{- A(Br—-1l+e? Se dr, 
0 


The change of variable e~ ** =z transforms (8.43) into 
1 


2 
Q(w) = a0 oA Re | e~* Ate! dz, (8.44) 
B 0 
The last integral can be expressed in terms of the incomplete gamma 
function ~ 
y(a,x) = ae dt 
0 
after making the substitution Az=1: 
Aj : io! ie ee 
g(w) = —- e@ Re} A" § fe i eee ai at 
B 0 (8.45) 


= —e"Re<A £ yi A+— ,A}>. 
B B 


For practical calculations, it is convenient to replace the exponential 
e” 47 in (8.44) by its series expansion. This leads to 
(-A | 


BOS ies 
B 


y, 
o(w) =--e* Re > 
B n=0 


or, after taking the real part, 
re eo Ga Ay n+A 
= ee, 8.46 
g(w) Aofe p> nt w? + (n 4 A)? B? ( ) 
Taking account of (8.42), (8.43) and (8.46), and recalling from (1.7.8) 
that multiplying by the function cos@ot in (8.42) leads to a frequency 
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shift of wo in the calculated spectra! density, we obtain 


aie a ne 
Se eee Aah ear Gat eee 
(8.47) 
Finally we note that, regardless of the form of the correlation coefi- 
cient, the following formulas hold for small and large values of 1, 
respectively : 
éxx,> = $43 eh" !2 Cosaot for 1t <Teo, (8.48) 


<xx,> = 443 e Kall? cos@ot for t Yt 
@ 


(Ka = 2064 R(z) ar) : (8.49) 
Oo 


3. Effect of Flicker Noise on the Frequency of an Oscillator 


We now consider another important special case of Gaussian fre- 
quency fluctuations, i.e., the slow fluctuations due to instability ia the 
current emitted by the cathode of the vacuum-tube oscillator, There 
is reasOn to believe that modulating fluctuations of anode current, 
with spectral density 

2 
S[UI,;@] = 6 Sz 


w! +e 


Ui, =1, —<h)), (8.50) 


called “flicker noise,” make an important contribution to the frequency 
instability of self-excited oscillations. The consiants / and a in (8.50) 
are determined [rom experiment, and | +¢ usually turns out to be close 
to unity. 

The fluctuations in emission current produce fluctuations in the 
interelectrode space charge, thereby affecting the size of the inter- 
electrode capacitance. The frequency of the oscillations is given by 
the formula 


oOo = 


l 
—=, (8.51) 
Ry gone 
in terms of the equivalent capacitance C,, of the tank circuit. Since C,, 
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depends on the interelectrode capacitance, and Since the latter in turn 
depends on the anode current {,, we find that changes in J, are ac- 
companied by changes in C,,, Suppose this dependence is described by 
the coefficient x, defined by the formula 
1 dc,, 
=— —, 8.52 
AO Ge dL (8.52) 
where jy can be found experimentally. Assuming that the fluctuations 
of anode current are relatively small, we can find the corresponding 
frequency fluctuations by differentiating formula (8.51), i.e., 
1 1 1 dc,, 


9 =O = Oy = = =~ 
2 J LC Coq al 


@ = Q(t) =— tuwl,. (8.53) 
because of (8.52), where the quantity frw, in (8.53) is evaluated for the 
average value of the emission current. Together, (8.53) and (8.50) 
imply that the frequency fluctuations have spectral density 


Or 


$[2;0] = see (8.54) 


where 
a = lwou’ <I>’. 
According to formula (1.5.30), if a=0, the spectral density (8.54) 
corresponds to the correlation function 
a w. 
{Q22,.) = —In 5. (8.55) 
22 wT 
Assuming that the fluctuations are Gaussian, we use formula (8.35) to 
find the correlation function of the generated signal. Direct integration 
of (8.55) gives 


t 


avy 
—7)(22_5 dt’ = —-- In-, 8.56 
[= 2) <aa, de =F in? (8.56) 
0 
where 
ar 
y ae . 


i 
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Because of the smallness of |/w, [see (8.62) below], there is only a 
negligible contribution to the integral (8.56) from the region of values 
t<I/w, where (8.55) does not hold. 

Replacing o2R(t) in (8.35) by the expression (8.55) and taking 


account of (8.56), we find that 
2 a 


2 at y 
xx, = 4Ag exp, — -—In->cos myt. (8.57) 
4n 


The exact calculation of the spectral density S[x; w] corresponding to 
(8.57) is difficult, but an approximale expression can be found by 
using the fact that the logarithm is slowly varying with respect to 7”. 
The Fourier transform of (8.57) is appreciably affected only by the 
region where 

at? 

4n 
and in this region the argument t in the logarithm can be replaced by 
the particular value ty defined by the formula 


fad ~ I; 
t 


2 
fae Sh (8,58) 
4n 1% 


Then (8.57) takes the form 


2 


; at y 
(xx, = $Ag exp<— —- In —?cos wot. 
4n 


To 


and hence has the spectral density 


S[x;o] = ae Az exp { — eo (8.59) 
B B 
where 
pean’. (8.60) 
114 To 


Equation (8.58) can be written in the form 
2 


y= In y, (8.61) 


where 2 
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Our previous considerations are based on neglecting the behavior of 
the correlation function (8.55) for r<I/w, and t> I/w,. This is per- 
missible if 


>|], 41€., P|. . 


If (8.62) holds, we can use the formula 
2 


ay 
dn = a In Va-1 


to solve (8.61) by the method of successive approximations. The first 
approximation is 


2 2,3 _ 

ay" awe 8x 
1,=— = =_]-- 8.63 
y1 Bn ‘Srna? € a ). ( ) 


the second approximation is 


_ay ay? 
In —, 
8x 8x 
and so on. Substituting (8.63) into (8.60), we find the following ex- 
pression for the width of the spectral line (8.59): 


2 2,3 

a aq ay , we 
Sy. ine 2 8.64 
B ‘a oe an Bx (; =r oe) 


Formula (8.64) can also be used to study flicker noise as a non- 
stationary process, provided we replace I/w, by the observation time ¢, 
since this is the only difference betwecn formulas (1.5.27) and (1.5.30). 


As a result, we obtain 
2,4 3 
awit e 
= ‘ 8.65 
an Jf, waeeke 8x S6°) 


y= 


According to (8.65), the width of the spectral line slowly increases with 
the time of observation. The cutoff frequency w, is determined by the 
smoothing of the fluctuations by various factors, e.g., space-charge 
and [frequency depression effects, parasitic capacitances, etc., and is 
inversely proportional to the smoothing time, i.e., a. = 1/t,,,. 
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4. Large Independent Phase Increments 


It is possible to regard the frequency Q(t) as a Gaussian random 
Process only in certain special cases. Therefore we now study the phase 
fluctuations by another approach, involving no assumptions about the 
normality of Q(t). According to (8.24), the phase shift Ap accumulates 
as a result of the addition of elementary phase increments 2 ¢r, These 
increments are statistically dependent, since the correlation time 7,,, 
of the process @ (t) has a finite nonzero value. However, choosing 
intervals somewhat larger than t,,,, we Can represent (8.24) as a sum 
of increments 


cory 


fot t, fot 2t, tot3ry 
ce | Qdt+ | Qdt+ | Qdt+... (t1> ta). (8.66) 
fo fot i tot 2r; 


which are now independent to a certain approximation. Since the phase 
appears in the exponential e’®, it is important to know the size of the 
mean value of these increments compared to x, since the statistical 
Picture will depend on this size. In the present section, we consider the 
case of independent increments which on the average greatly exceed x 
(the case of small increments will be considered in the next section). 
This corresponds to the inequality 


Cal cor > | (8.67) 


If t is the time it takes for a phase shift of order x to accumulate 
(e.g., gt ~ 1), then (8.67) implies 


T < Teor 
so that the frequency 2 does not manage to change very much during 
the time t. Therefore, for such a value of 1, 
tot? 


| OQdt~ Or (8.68) 


to 
and 


<el4*y ms [ e@w(a) dQ. (8.69) 
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Hence according to (8.33), 
{xx = 4Ah Re {emf eere(apaat. (8.70) 


If we increase t, then (8.69) and (8.70) cease to be valid when t attains 
values of ordert,,,. But before this happens, both the right-hand side of 
(8.69) and the correlation function <xx,) become negligibly small. In 
fact, it is assumed that the function w(Q) satisfies certain continuity 
requirements and hence has a Fourier transform which falls off 
rapidly with increasing frequency (increasing t, in the present case). 
Therefore (8.69) takes large values in the region t~ I/oy, but its values 
become small if t > 1/ay. To see that <xx,>) becomes small for 1 > I/og, 
we need only consider intermediate values Il/og<t<t,,, for which 
(8.70) continues to hold although the right-hand side has already fallen 
off sharply. 

Since both sides of formula (8.70) are small in the region where it 
breaks down, we can use (8.70) for all t when calculating the spectral 
density. Naturally, the Fourier transform of the characteristic function 
will involve the original probability density, and in fact, the spectral 
density corresponding to (8.70) is just 


S[x;@] = nA§[We(@ — wo) + Wa(— @ — @)]. (8.71) 


As before, we neglect the effect of the tail of the function wy(—w— 9) 
entering the region of positive frequencies from the region of negative 
frequencies (this is justified by the narrow-band character of the signal). 
Then (8.71) becomes 


S[x;o] = 1AZWa(w — Wo). (8.72) 


Thus the spectral density is completely determined by the probability 
density of the frequency. Although this result seems obvious at first, 
it is valid only for the case of large independent phase increments, i.e., 
for the case where the frequency fluctuations either have large variance 
or are of long duration. 

Example 1. If 2(1) is a Gaussian random process, then it follows at 
once from (8.72) that 


S[x;o] = 


i ee (8.73) 
2 Sa 
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which corresponds to (8.48), as might be expected. When the corre- 
lation function has the form (8.36), this formula can be obtained from 
(8.40). In fact, because of (8.67), the argument of the function K, is 
large, allowing usto replace K, by its asymptotic expansion, which gives 


S[ ]= aa fF — ORT oor 
x,@ i 
2 [Tove oat? + Ho = w wo)" ee? 


x exp {o5t-4, eo Teor Joir2, + (wo _ )"} 


Thaw oe 2 2 
@a-w ao-wW 
CAtcor ee "4 Wo)’ Sod om 
OQ cor 20% 
Vv ORT cor + (w ad Wo)? x CAC cor 


for W— Wo <a At cor, the spectral density S[x ;w] immediately reduces to 
(8.73) for |w—wo| KO AT cor: 

Example 2. Next suppose 92(1), instead of being a Gaussian pro- 
cess, is proportional to the square of a Gaussian process. This will be 
the case if B=0, since then 


Since 


2 


{= — dwoM'yu? = — dus, 
Ag 


according to (8.19), where 
pees 
7 WyM"y 


[cf. (8.21)]. Substitution of ¢ into (8.23) gives 
Q= — Swope! s5. (8.74) 


where u has the probability as: 


Pie ade 


WW) = Fane 


Solving (8.74) for u and substituting the result into the expression for 
w(u), we obtain 


3 1/2 
w(2)= wu IF ar rae (ania) 


3A5 |Q| 
xexp<——, =>— °?, 2<Q). 
P| 4u*a? 1309 ( ) 
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Therefore (8.72) implies 


Sfxio) = 22[ 3" |" ep J 2 on 2 
: 4ua| 13a (wo — w) Aya? 13, 
for wo <a, (8.75) 


S[x;w]=90 for w>a@p. 


There is no essential difficulty in finding S[x; @] in the more general 
case where § #0, or in the case where (8.20) has to be used instead of 
(8.23), because of the large size of <7). 


5. Small Independent Phase Increments 


Next we consider frequency fluctuations whose correlation time is 
much less than the time it takes for large phase shifts of order x to 


accumulate. In this case Pe oe (8.76) 


so that the large phase shifts are essentially sums of large numbers of 
independent random variables. Therefore the phase shift which accu- 
mulates during times of order 


1 
T z i > Teor (8.77) 
o 


na 


has an approximately Gaussian distribution (due to the operation of 
the central limit theorem), with characteristic function 


Celtdey, — @~#49)?)/2 | (8.78) 
where 


<(4g)*> = | (t — |t'|) (2,5 dt’ = Kgt 


(Kg = | (22.) ar) 
0 


because of the condition (8.77). It follows from (8.33) and (8.78) that 


(xx,> = $42 ell? cosampt (TD Teor). (8.79) 
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Equation (8.79) fails to hold only in the range t<1,,,. which is 
narrow compared to the effective width of ihe function e~*"/*, equal 
to 

1 1 
In calculating the spectral density corresponding to (8.79). tlie interyal 
TST, can be neglected for frequencies w< K, since 11 forms only a 
small part of a period. Therefore, using (8.79) for all t, we obtain 


Ko 


(w — w)? + 4K? (lo — wel = K). (8.80) 


S[x;@] = 445 
Using (8.80), we can find the broadening of the discrete spectral line 
due to the Auctuations, since this requires knowledge of ilte spectral 
density in precisely the region of small frequency deviations w—wy. 
In fact, it is clear from (8.80) that the [requency instability broadens 
the spectral line by an amount 


AoxKg= | (QQ) dt. (8.81) 


—~7) 


One is often interested in the value of the spectral density for larger 
deviations (of order ew) [rom the fundamental frequency. i.e.. for 


|w = Wo| z — > 
cor 
since the slowness of the Auctuations makes the quantity !/t,,, rather 
small (<ew,). Because of (8.76), only small phase shifts accumulate 
during time intervals of order T,,,, i.e., 


fott 
| Qdr<1, eM? x14 iAg—4(Apy +... (8.82) 


Therefore 
fott fate 


l 
Ke4"y = 1 = | | CQ(H Qt’) dt dt’ (8.83) 
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for t<I/og, and 


(xx, = $A3 f - 4 | (« —1')(2,2.. a’ COS @ot. (8.84) 
0 


To calculate the spectral density for w—w, 2 1/t,.,, we first find the 
spectral density of the process 


d 
n(t) = ore ie '*@, 


whose correlation function 


<nnt> = (29, e'4*> (8.85) 
can be replaced by (22,> for all t, L.e., 
Cant = (20, (1+ idg +...) > (22). (8.86) 


This can be done because of (8.82) if t<I/og, while if t2 l/ag>t., 
both sides of (8.85) are near zero and hence differ only slightly. 
According to (8.86), the spectral density S[”; @] coincides with the 
spectral density s[Q; w] of the frequency (rf). But then 

S[y;:0] =o7S[z;0], 


where z=e" ® is the process with derivative 7. Replacing S[y; w| by 
s[Q; w|, we conclude that the process z, with correlation function 
<e'4*), has spectral density 


S[z;o] = *,8[0;0). (8.87) 


To find the spectral density of 
(xx,> = 443 Re {e'*(z2*)} 


[cf. (8.33)], we need only multiply (8.87) by 446 and then recenter the 
spectral density at [frequency w,: 


2 SLQ;lo — 
S [xs0] = 4435 [zilo ~ agl] = 44372 ol 


1 
Teor. 


(8.88) 
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Near the fundamental [frequency wo, this expression becennes infinite, 
and then the previous formula (8.80) should be used instead. 

It will be recalled from (8.72) that the spectral density S[x: m] of 
the generated signal is proportional to the probability density of the 
frequency, in the case of large independent phase increments. Now, 
however, S [x;w]| involves the spectral density of the frequeucy fluc- 
tuations. 

It is a characteristic feature of the case of sinall independent phase 
increments that the behavior of the spectral density for sinal] devi- 
ations @—W,) from the fundamental [frequency is different from its 
behavior for large deviations. This twofold behavior does not occur 
for large increments (see Sec. 4). 

Example 7. Consider the Gaussian frequency fluctuations con- 
sidered earlier, leading to the spectral density (8.40). With the con- 
dition (8.76) and for small deviations (w—@,)? <1,,7, the argument 
the function K, (z) is much less than unity and hence can be replaced 
by its asymptotic expression I/z. This gives 
CAtcor 


S[x;@] = Ag 


or inter a (8.89 
: ( = Wa)? as Onl cor ) 


which agrees with (8.80), since 
Ka — 20K cor 


[as can be seen by integrating (8.30)]. 

Next suppose the condition (8.77) is combined with large deviations 
(w—wo)*t2,,> 1. Then, neglecting o§r2,, compared to (w —«W,)"t?,,, 
we find from (8.40) that 

2.2 


Tal eor 
S[x3@] = Aj ——_ Ky (teorlo — ol), (8.90) 
|w — wal 


which agrees with (8.88), since the correlation coeflicient (8.36) corre- 
sponds to the spectral density? 


S [Q; w| = Ag Ht, 0K y (ise w) : 


! See I. M. Ryshik and I. S. Gradstein, op. c/t.,, formula (5.116), p. 250. 
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Example 2. For the Gaussian process with correlation function 
(8.41), the condition (8.76) for small independent increments takes the 
form A<I, and guarantees the rapid convergence of the series (8.47). 
Retaining the first two terms of this series and neglecting quantities of 
order A”, we obtain 


AB AG 


aia (CES ear a] (CN Ea 


In particular, we have 


ABAS 
elma aae ee 
and 


AB* Ao 


S[x;@] = a ~ oe) Tw oy B] 


for |w—w,|~ 8 


? 


in complete agreement with (8.80) and (8.88), since 
4Ap° 

Ky, =2AB, S[2;w] = -—— . 

9-248, S[9;0] = 

Example 3. Suppose the random process (, defined by formula 

(8.19) and figuring in (8.23), is essentially non-Gaussian (yo 2 f). Then 

its correlation function coincides with the correlation function (7.37) 
of the process (7.35), and hence 


, 2 
(20,) = (woun)?(“") PRC) + 277 RCI 
= (41jt2@997Ag *)*[2R?(c) + (<) R(t)]. (8.92) 


The form of the corresponding spectral density depends in an essential 
way on the concrete form of the correlation function R(t) in (8.92). 
For example, if R(t)=e7''!*, then R(t) and R?(c) have spectral 
densities 
AT cor Bor 
ot, +1 7 wt, + 4’ 
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respectively. Therefore 


2a0\*f 4t ty 3 
5 Qo: = 2 2 bohtd aa cor A. ) ; , 
[Q;a)] = 2(Ht200) Poy 4 & OT t ' 


and hence, according to (8.88), 


4 2 
S[x;@] = 4 (up. A9) (7) a | bey 
a 


(@ = &o)*[(w— eg)? ti, 14 


+ B 4 Teor (R 93) 
yo (w = Wo)” os +1 


At the same time the discrete spectral line is described by the expression 


(8.80), where 
4 2 
K = (112@9)° (=) [ + ( ) | Terr: (8.94) 
Ag yo 


As can be seen from the above discussion, almost all the power of the 
oscillations, equal to 4.AZ, is concentrated in the discrete spectral line 
with spectral density (8.80). The more broad-band fluctuations, whose 
frequencies [all in the range 


|~ — wal ~ 1 


cor 


have small power. The order of magnitude of the spectral den-ity in 
this range is 4Aéogr;,,, and its total power can be estimated as 
4AgoZt2,,, 2 quantity which may turn out to be smaller than the 
contnbution at these frequencies from the ainplitude fluctuations 


(whose effect has been neglected). 


6. Modulation of Self-Excited Oscillations by Noise 


The slow fluctuations considered so far, which upset the stable 
operation of an oscillator and cause amplitude and phase “departures,” 
are characterized by their small size, and hence lead to only small 
deviations from the stable values of the amplitude Ag and !rcquency 
Wo. However, in some cases, the oscillator is deliberately subjected to 
the action of slowly Nuctuating noise of much greater intensity, e.g., 
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for the purpose of obtaining noise-modulated oscillations (as in noise 
generators). If the correlation tine of the modulating noise is greater 
than the relaxation time of the amplitude, then this case resembles 
that just considered, where the amplitude and frequency of the self- 
excited oscillations are modulated by ambient noise. The only differ- 
ence is that the noise intensity is now large enough to produce deep 
modulation, i.e., a large Auctuational scatter 


DA ~ AG. (8.95) 


The resulting oscillations are still described by equations (8.3) and 
(8.4), which take the form (8.20) and (8.21) if the modulating voltage 
fluctuations are appliedtothe grid of the oscillator, except that now we 
must set w=«, rather than = Du, in the expression (8.19) for ¢. 

To calculate the spectral density of the generated signal, we can no 
longer use formulas (8.32) and (8.33), and instead, we must now take 
account of the amplitude fluctuations: 


x =A(l)cos (wot + 9), 


ote 


(xx,) = 1 Re [(4 (CJAC) exp f | Q art) co . (8.96) 


As before, there are two essentially different fluctuational processes, 
depending on the size of ogt.,, compared to unity. We begin with the 
case of large independent phase increments 


Onl .o, > 1. (8.97) 


The presence of the phase factor e'4°(4g@ ~agr) causes the correlation 
function (8.96) to fall off sharply for r>I/og, and in fact, (8.96) 
practically vanishes for r> I/og. But the range tS |/aq where (8.96) is 
appreciably nonzero is much narrower than the correlation time, 
because of (8.97), and hence the amplitude and frequency change very 
litle in chis range. Therefore the correlation function (8.96) takes the 
form 

&xx,> = } Re (4A? (L) ef elm) | (8.98) 


where knowledge of the univariate distribution w(C) is sufficient to 
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calculate the average. Since 
i (A? (Lye OY ef! de = 2n CA? (C)S[ — AKQ)] . 


it follows from (8.98) that 
S[x:0] = 1¢A?(0)d[@ — wg — Q(0))d. (8.99) 


To evaluate the average in (8.99) [an integral involving the proba- 
bility density w(C)], we use the properties of the delta function. 
Suppose the equation 

a(t)-2=0 


has 7 roots, which we denote by 


¢ = Q(z), si OA2Z)s 


Then the average can be written as the following sum over the different 
roots: 

dé 

dQ rn 9 te - 


S[x;a] =n ¥ A*(C)m) (8.100) 


9) 


If the function Q(f) has a single-valued inverse €=Q(Q), the sum 
(8.100) reduces to a single term, involving the probability density of 
the frequency: 

S[x:@] = 2A? [Q(w — wo)] we(w — wy). (8.101) 


We now apply (8.100) to the specific equations (8.20) and (8.21). 
Dropping the term giving the nonrandom [frequency shift, and using 
the symbols yx and Ag with their previous meanings, we can write 
these equations in the form 


A= Aafia e (8.102) 
li 
@ = Wott + 29 won” . (8.103) 


To keep things simple, we replace the number 29 by 30 in (8.103). The 
function 


Q(0) = woust + Jol? (8.104) 
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has a double-valued inverse 


C= 2,2(Q), 
Pare 
Q,,2(Q) = ;(- Ha + ji 7 10), (8.105) 


Substituting (8.105) into the expression Wg (s:. +5¢) for the derivative 
d2/d¢ of (8.104), we find that both roots lead to the same value of 

dt 1 

dQ ; 


50), rae 
> wy id + 10--- 
Wo 


Therefore (8.100) finally gives 


Sinope 4 [ean at, (=Bt £4) 


= t— --+ 
5 


H@d Je ; 
Pack es Su bal m( s rave) (8.106) 


5 
where 


>O. 


b= y3 + 10— 
Wa 
This expression is valid for frequencies leading to positive values of v. 
The fluctuations have vanishing spectral density in the region where 
v <0. 
For strong external noise, producing deep modulation, we have 
<t7) ~p?. Then the spectral density (8.106) of the generated signal lies 
in the frequency band @) — dw <w <w,+ do, of width 


240 ~ jo. (8.107) 
We now turn to the case of small independent phase increments: 
QT cor < 1. 


Then the spectral density of the generated signal has a twofold struc- 
ture, ie., there is a strong narrow spectral line together with weak 
fluctuations which are more broad-band. The discrete spectral line can 
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be investigated by the same method as in Sec. 4, since the amiplitude 
fluctuations have no discrete component but lic in the hand 


1 
Jo — wel ~ —. (8.108) 
The phase fluctuations considered in Sec. 5 also lie in this hand, where, 
as noted on p. 215, their total power is of order LAjoate Atthe same 
time, for deep modulation (8.95), the amplitude fluctuations, which 
lead to a correlation function of the form 


(xx) = ¥¢(AA,) COS Wor, (8.109) 


if it is assumed that the phase ¢ is constant, contribute power of order 
4A7. In the present case, this power greatly exceeds that due to the 
phase fluctuations. Therefore, for deep modulation, we can neglect the 
elect of frequency fluctuations if we are interested in the range 
|o—ag|~1/Teo (the frequency fluctuations beeome important if 
| — wq| €1/t eo). This allows us to use formula (8.109), which leads at 
once to the following relation between S[x; @] and the spectral densi- 
ty of the amplitude: 

S[x;o] =}S[A;o — a]. (8.110) 


Since the amplitude is a zero-memory nonlinear transformation of 
the random function {(f) [see (8.102)], its speetral density can be 
calculated by the methods given in Chap. 1.8. For examiple, if 


An . ne? 
p20, tan Se: Am Ag fi 4", 


we can use the next to the last formula on p. 1.236, oblainme the spec- 
tral density 


is] 


was, “ck A 
S[A — <A); @] = 4AG F cesittan( $2) [RC cos cat dr. 
. (8.111) 


The intermediate case of medium-sized independent phase incre- 
ments ¢ot,.,~1 is the most difficult. Here formidable calculations lead 
to some results of no great generality or preeision. There is an 
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exception, ofcourse, namely the case of Gaussian frequency fluctuations 
Q(t). Then we can use the general rule to immediately write the joint 
characteristic function of the random variables 2, 2, and Ag: 


<exp {i(uQ + vQ, + wAg)}> = exp{— $[(Q?>(u? + v”) 
+ 2¢20,> uc + (Ag)*> w? + 2(QA@) uw + 2(2.Agy ow]} 
= exp i{(uQ + vQ,.)}> exp {— 4<(4@)”) w? 
— (QAgy uw — (Q2,Ag) vw}, (8.112) 


where <exp {i(uQ + 0Q,)} is the two-dimensional characteristic function 
of Q and Q., Let A(Q) be the function giving the dependence of the 
amplitude on the frequency. Then the quantity ¢A(Q)A(Q,)e'4*> 
figuring in (8.96) can be expressed in terms of the characteristic 
function (8.112), i.e., 


¢A(Q)A(Q,)e4%> = | [[[[A@racgerso- ae 


(2n)’ 
x Celt Fee +i4ey GO’ dO’ du dv, (8.113) 


where the validity of (8.113) can easily be proved by noting that 


1 
. jee “du = 6(Q' — Q), 
iq (8.114) 


aaa dv = 5(Q,-Q,). 
21 

Substituting (8.112) into (8.113), integrating with respect to u, v, 
Q’, Qi and using (8.114), we obtain 


(A(Q) A(Q,)e'4%) = 0 PP? (A (041 (OAQ))A (2,41 (QAQ)))- 
(8.115) 


Thus the problem reduces to finding the correlation function ofa nonlin- 
ear zero-inemory transformation A= A(Q2+ m) of the random process 
Q(t), where m=i{QAQ@). Since A(Q+m) is an analytic function of m1, 
we can carry out the calculation by Rice’s method, say (see Chap. I.8, 
Sec. 4), regarding m as a real constant. Then, after calculating the 
correlation function 


(xx,) = 4e7 (49)? Re (A (2 + m)A(Q, + m)pel@™"}, (8.116) 
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mand <(4@)*> must be replaced by their actual values 


m = i<Q49) = i(2,4e> = ioa | R(v) dt’, 
: . (8.117) 
((49)*) = 208 | (2) RO) Ae, 


CHAPTER 9 


Synchronization of an 
Oscillator in the Presence of Noise’ 


There are many problems of cadio engineering (requiring, for 
example, large channel capacity or high noise immunity) which can 
only be solved by using oscillators with a high degree of frequency 
stability. However, oscillators are always subject to the action of noise 
(e.g., fluctuations in anode current due to shot noise, Auctuations in 
external voltages, etc.) which decrease the frequency stability and in- 
crease the bandwidth of the generated signal. An effective means of 
achieving self-excited oscillations with high frequency stability is the 
use of external synchronization, i.e., the given oscillator is subjected to 
a synchronizing voltage produced by another oscillator which has 
greater frequency stability despite its smaller power. The effect of the 
synchronizing voltage is to “lock in” and stabilize the {requency of the 
primary oscillation. 

Despite the use of a synchronizing voltage, the presence of noise still 
manages to produce departures from a completely synchronous oper- 
ating regime. In the first place there are incessant small fluctuational 
deviations of the phase from its synchronous value. Secondly, there 
are occasionally large phase deviations, comparable to 2/2. Thirdly, 
the phase sometimes (albeit infrequently) jumps by an integral number 
of periods. These uncompensated phase Jumps accumulate and cause 


1 The Father would like to thank R. V. Khokhlov for advice which was helpful 
in obtaining a number of results presented in this chapter. 
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the mean frequency of the oscillations to difler from the synchronizing 
frequency. They also lead to the occurrence of irreversible phase 
diffusion, thereby producing frequency instability of a dilTusional 
character. 

The first effect (small phase Auctuations) can be treated by using Lhe 
linearization method. The other effects are essentially nonlinear, and 
are most conveniently investigated by using the apparatus of Markov 
processes, which, in dealing with nonlinear probleins, has the great 
computational advantage of allowing one to determine thie stationary 
distribution by quadratures. 


1. The Basic Equations. Small Deviations from the Synchronous 
Regime in the Linear Approximation 


If the synchronization voltage is applied to the indictive branch, 
then, according to (4.17), the operation of the oscillator is described 
by the equation 


¥ + Wax = WA oF(® | — RCx 
w, (9.1) 


2 . 2 
— wo-MCU, sin o,f + oa,MT,. 


in terms of the voltage x= w,M (I—J_). In the case where the noise is 
not due to shot noise but to a Auctuating voltage u,(r) applied to the 
inductive branch, wgw,M I, should be replaced by aga, ¥CN,. 

The next step is to write (9.1) in standard form. Unlike (4.30), we 
now define the amplitude and phase in terms of the synchronization 
frequency @, instead of the resonant frequency @ of the tank circuit. 
This gives 

x=Acos(w,t+ 9), *=—o,Asin(o,t + 9) (9.2) 


instead of (4.30), and hence 


es sin(w,t + @) cos (wt + @) 


a (¥ teerv) (9.3) 


(¥+@2x), g= 


s 


[cf. (4.32)]. Using our previous approximation (4.23) for the tube 
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characteristic and introducing the notation 


2 
w MS — RC 
=—(MS—RC), 43=4——_, 
o, My 5 
Wo — 5 ; M Se 
A ee DO Os E= agMCUa = 7 Uns 


s 


we can write (9.1) in the form 


2 035 4 (x\ Ho 2 
X + 0;X = ~ 24M,x + EW% La a, — w;Esinwt — on(t), 
(9.5) 


suitable for substitution into (9.3). Here y(t) is the random process 


2 2 


= °MI = oMCh 9.6) 
=. c ee re E 
n rp ovon bs ( 


depending on the nature of the noise. After making the indicated 
substitution and dropping oscillatory terms in the resulting standard 
equations, we arrive at the following truncated equations in the first 
approximation: 


éw@ A: 
A= —(1l- ZG ge alg aiaian (ota): 
2 AZ 2 


OE a, 9.7 
g=A— 57 sine + 7 cos (wt +9). Oa 


The Aluctuational terms nsin® and A~‘»cos@ appearing in (9.7) can 
be simplified by the same method as in Chap. 4, Sec. 4, if the corre- 
lation time of the process y(t) is sufficiently small compared to the 
relaxation time: 

1 
vcr Stet (9.8) 
EWa 
(If this condition is satisfied, we can apply stochastic methods and the 
Fokker-Planck equation to the present problem.) As a result, we 
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obtain the simplified equations 


£0, A? wE ; 
A=—(1--— j[A4+— cospt dc, 
ae : 9.9) 
PEW gat Ore ee " 
2A A’ 


where &, and €, can be regarded as independent zero-mean delta- 
correlated Gaussian random functions: 


(E429 =090, Cate) ae (9.10) 
(iste) = (E262) = K 6(t), K= 7 Ky (@,). 


If w, coincides with wo, then the random functions €,; and ¢, are 
connected with the random functions €, n, C’, n’ appeating in equations 
(4.66), (4.67) and (7.4) by the relations 


€, = Won = Aon’, €2 = Mol = Ape. 


In deriving (9.9), we assumed that the synchronizing excitation is of 
sinusoidal form. However, exactly the same cquations describe the 
case where the external excitation is a penodic function of arbitrary 
form, e.g., a sequence of pulses, provided that the lrequency of the 
excitation is near the fundamental frequency of the osciflations 
(synchronization at multiple or fractional frequencies will not be 
considered). Any pefiodic synchronizing signal /,(¢) can be replaced by 
its Fourter expansion 


f. (1) = Eg + Ey cos@y + E} sin wr + E, cos 2,¢ + Ey sin 2 +... 


Substituting this expansion into (9.3) and dropping oscillatory terms 
to a first approximation, we find that all terms except £, cosi,f and 
Ejsinw,t disappear, leaving 


E, cos w,t + E,, sin wt = Ei + Ei? sin (wr + W). 


Moreover, the phase w depends on the choice of the (ime origin, and 
can be set equal to zero. Therefore, insofar as its synchronizing action 
is concerned, the function {(t) is completely equivalent (at least, to a 
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first approximation) to the sinusoid Esinw,f considered above, provided 
we now write 


22 


E= {|- [4.00 Cos w,t a(w.)| + : [£00 sin wt acon] ; 


In this sense, the results obtained below are valid for a synchronizing 
signal of arbitrary form. Thus, if the synchronization is produced by 
pulses of height Ey, occupying the fraction © of a period, the appropri- 
ate choice is 


2 
E=- Egsinz@. 
7 


The basic system of equations (9.9) is hard to solve in its most 
general form. However, it can be used to obtain a number of important 
special results. First we consider the case of no random excitation at all 
(€,=€,=0, K=0). Then there will be a synchronous regime with 
constant values A,, ~, of the amplitude and phase, provided a certain 
condition for “locking in”’ is satisfied [see (9.14)]. Equations for A, 
and ¢, can be obtained from (9.9) by setting A and ¢ equal to zero. 
This gives 


E 
e(ay — l)a, = 7 cos, 
0 
A E (9.11) 


—-d;=——sing,, 
w Ag 


s 


where a, = A,/Ay. Combining the two equations, we obtain 


24 \? E\ 


Solving this cubic equation in aj, we can find stationary values A,, g, 
of the amplitude and phase for every case of interest. Equation (9.12) 
is easily studied graphically by writing it in the form 


x(x— 1) = (=) - (=) x (x= aj). (9.13) 


&Ag €@,. 
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05-025x 
/ 


x(x- iy 
ee 
Ti 
14 


Se 


Fig. 22. Graphical determination of the stationary amplitude a; - 4 \1. The line 
AB corresponds to the parameters (E/eAo)? = 3, (24/evs)* = i and CP to the 
parameters (E/eAo)? = 4, (24 /ecs)? — 3. 


In Figure 22, the graph of the function x(x—1)? is intersected bv the 
line corresponding to the right-hand side of (9.13) and deterniined by 
the parameters E/eAg and 2A/ew,. If there are three points of inter- 
section instead of one (as in the case of the line CA), it can be shown 
by considerations resembling those on pp. [36-(38 that the stable 
amplitude corresponds to the point NV with the largest abscissa. 
A synchronous regime is possible only if the “mismatch” 4 does not 
exceed a certain value depending on the amplitude £. It follows Irom 
the second of the equations (9.11) that the condition for “locking in” 
takes the form oF mn 
A<-- or A<-, (9.14) 

2A, ay 
where 4,=w,E/2Aq is a system parameter, called the sywchromization 
bandwidth. Assuming that this condition is salisfied, we now study the 
case of small Auctuational deviations from the synchronous regime. 

The expressions on the right in (9.9) without the fluctuationil terms 
€,, €, (ake small values near the point A= A;, p=@,, Since they vanish 
at this point. Therefore we can expand these expressions in Taylor 
series near A=A,, p= Q,, retaining only linear terms. In calculating 
the corresponding first partial derivatives with respect to A and 9, we 
use (9.11). Since linearization is possible only in the case of weak nojse, 
the Aluctuational term ¢,/A can be replaced by ¢2/4,. Moreover, the 
term K/2A can be dropped, since it is of the same order as the omitted 
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quadratic terms. In this way, we arrive at the following linearized 
equations 


jai ~1 
oA = — &u, 0A — AA, 59 + €,, 
(9.15) 
og = —dA-—€ s a °) 4 a2 
! 2 A, 


where 


After introducing the abbreviated notation 
SA=y, Ajdp=2z, #0,(3a} —1)=25, ew,(at— 1) = 20’, (9.16) 
the equations (9.15) become 


po-—ody—dz+, 


2=Ay—6d'2+,. 0.17) 


The system (9.17) can be solved by ordinary methods, and the initial 
conditions have no effect if we are interested only in the stationary 
regime. This corresponds to regarding the perturbations ¢, and ¢, as 
turned on in the very remote past (t=— 0). Applying the spectral 
method, we replace the differentiation operator in (9.17) by iw, and 
solve the resulting equations 


(im +d)yt+ 4z2=%,, —Ayt(int d)z=¢, 
as an algebraic system for y and z. This gives 


|_ (lo + ')b — Ab 
- Z(iw) 
_ Ag, + (fm + S)E, 
7 Z (iw) 


= yISh + Ly2bo, 


= Lies + Ly2¢2, 


where 
Z (iw) = (im + 5) (iw + 5’) + A? 


and the different L’s are abbreviations for certain complex expressions. 
It follows from the usual rules governing spectral densities of linear 
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transformations of stationary processes that 


2. 2 
Kk, = ILyrl! Ken + Ibyal Kea 
= ([L,,1° Ky + [Lal ke, 


* * * .. toes = Bares ford ges 
Kyz =H Ky = LyyLeyker + Ly L-2Xe2 ‘Cer FNS K) 


where we use the fact that ¢,(t) and €, (t) are independent. In expanded 
form, we have 


ee le oa, 
K,(w) = 48 [y3@] = 522-9 Bara Re 
(55° + 47 ~o’)? 40° (84+ 5) 
_@ ee 
=4S[z:0 ea : 9.18 
- —d+2i 
K,.(w) = $S[y,2;0] = ; “ AK. 


(55° + 2 — wy? +o (545) 


Explicit expressions for the correlation functions corresponding to 
the spectral densities (9.18) can easily be found by taking inverse 
Fourier transforms. In fact, spectral densities like (9.18) have already 
been considered in Chap, I.2, Using entries 5 and 6 of Table |. p. 1.25, 
we see that the correlation functions of the processes )'(f) and z(r) can 
be expressed in terms of the functions 

e "loos ut, e 7! sin yr, (9.19) 


where the quantities y and v satisfy the relations 
yprv=55'4+ 47, 2~=548' 


and hence equal peas roe 


te tie) 


Forming the linear combinations of (9.19) which lead to (9,18), we 
easily obtain the correlation functions 


K 1 
k = — ——_ e577 4 6 5’ + 247) cosy 


5" 
296 = 5) sin vit 
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I 
k,(t) > ae Saget \(e + 55’ + 247) cos vt 


~ 4y 55° + 2? 


} 
+ 2(5 — 5’) . sin v al : 


| ee Ge BNC oe y, 
Kyl) = wel? —~o- 2) fe 7 (cos oe vil) 
(9.21) 


Setting t=0 in (9.21), we obtain the variance and correlation coef- 
ficient of the amplitude and phase fluctuations: 


K 5'y + &? K dy + 4? 

2 2 2 2 

Py ee oa, Cee Al C69) = 
LE ok ae eee x5 
nr 2y 50’ + A’ y= [(S’y + 47) (sy + 47)) 17" 


The results just obtained contain the quantities defined by (9.16) and 
(9.20), and can, of course, be written in other ways (we omit the 
details). However, it should be noted that the amplitude scatter is 
always less than the scatter in the perpendicular direction, i.e., 


<(5A)’) < At <5)’. 
Correspondingly, the system always has more “‘stiffness” with respect 


to the ainplitude (the coordinate y) than with respect to the coordinate 
z (6>6’). Writing the cross-correlation coefficjent in the form 


R,, = ~— £00,074 (55'y? + 2477? + ANNU? 


we see that its sign is determined by that of the mismatch 4. 

The physical picture is particularly simple if 4=0 (no mismatch). 
Then the amplitude and phase fluctuations are independent, since the 
system (9.17) splits into two uncoupled equations, which clearly de- 
scribe exponentially correlated processes y(r) and z(t). As we know 
from formula (1.4.217), the variance of such a process equals the 
intensity of the random impacts divided by twice the “stiffness,”’ In 
fact, setting 4 =0 in (9.22), we obtain 
<yz> = 9. (9.23) 


2K Se 
("> = 55 <2) = 557 
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In using this formula, it helps to bear in mind the appieximate 
relations implied by (9.12) for the extreme cases of small and large 
amplitudes of the synchronizing signal. Thus 


> E : E 
aq, =l+ ---, 2x2ew,, 26° ew, -=24, (9,24) 


if E/eAg <1, while 


E \?A EX? E\ 
a; = { —- , 25 Jew, -- , 26's cof (9,25) 
EAp &A, £Ag 


if Ej/eAg> 1. 

Clearly, if (9.24) holds, the amplitude stiffness is the same as that of 
an autonomous oscillator. The phase stiffness is much smaller, leading 
to a large phase scatter, in fact, large enough to cast doubt on the 
applicability of the linearization method. Since the linearization 
method is valid only if <(5g)?) <I, Le., if 


KA 
<2?) x -° € Al, 
w,E 


it ceases to be applicable if 


WK, (a,) 
——-__ (9,26 
E Ss 2A , ) 


90 

[cf. (9.10)]. As the synchronizing excitation is increased, the stiffness 
with respect to both amplitude and phase increases, with the phase 
stiffness increasing more rapidly, so that it almost catches up with the 
amplitude stiffness. In other words, the phase scatter decreases more 
rapidly than the amplitude scatter, and eventually approaches the 
amplitude scatter. In fact, according to (9.25), if E’eAg> I, the 
standard deviation of the phase is only \/3 times larger than that of the 
relative amplitude 5A,/A,. 

Next we calculate the correlation finction and spectral density of 
the generated signal x= Acos(w,t+q). If the linearization method ts 
applicable, we are justified in writing 


Zz 
x = (A, + y) cos (. + Gy +z) 
1 


; (9.27) 
ms A, cos (wt + py) + ¥ Cos (w,t + Y) — 2 SIN (@,t + a), 
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just as we linearized the basic equations (9.9) themselves. Multi- 
plying (9.27) by the same expression taken at a different time and 
averaging the result, we obtain the correlation function of the signal, 
involving the correlation functions of y(r) and z(r) which have already 
been calculated. If the process x is handled coherenrly, under circum- 
stances where the phase of the generated signal can be compared with 
the phase of the synchronizing signal, then x is a periodic non- 
stationary process (cf. Chap. I.5, Sec. 4), whose correlation function 
(obtained by the use of coherent operations) not only depends on the 
time difference t but also varies periodically as both times are shifted 
by the same amount along the time axis. On the other hand, if x is 
handled incoherently, we can carry out an extra average over the in- 
determinate initial phase, which can be regarded as a uniformly 
distributed random variable. The resulting process, with a random 
initial phase, is now stationary, and its correlation function <xx,> 
depends only on the time difference rt. 
We can find <xx,> most simply by applying the method described 
in Chap. I.7, based on the use of the complex random process 
Z=A,+y+Hiz, 
x= Re {Zeorton}, 
The correlation functions of the real and complex processes are con- 
nected by the relation 
<xx,) = 4 Re {(ZZP ye} (9.29) 
[cf. (1.7.16)], and their spectral densities by the relation 
S[x;@] = 4S[Z;o-— o,] + 48S*[Z:0 + o,] 
= iS[Z;a—a@,] for w,>0, 
eo S[x;a] = $xz(|o| — @,). (9.30) 
Taking account of (9.28) and the expressions (9.18), (9.21) found 
above, we can determine the statistical characteristics of the complex 
process Z(f): 
(ZZP) = At + Cry) + C220 — 1CPze- 2) 
Kz(@) = 2n Aj 6(w) + x, (@) + K.(w) — i[k,.(@)-— KE (o)] (9.31) 
2w* + 5? 4 57 + 247 + 4wA 
(55' + 42 -w}? + 07(5 457 


(9.28) 


= 2nAj 5(w) + 
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The expressions (9.31) can then be substituted inte (9.29) and (9.30). 
Thus for the spectral density we obtain 


S[x; a] = nAj 5(lo| — @,) 
(|o| — w, + 4)* + 4(5 + 8°) K 
[55’ + A? — (jal — 7? + (lol — @,)7(5 4 9? 
(9.32) 

Here, just as in Chap. 6, the presence of correlation between the ainpli- 
tude and phase fluctuations causes the spectral density to be asym- 
metric with respect to the fundamental frequency w, (the numerator of 
the second term on the right is symmetric with respect to w,— 4. while 
the denominator is symmetric with respect to w,). 

Setting t=0 in (9.29) and in the first of the equations (9.31), and 
taking account of (9.22), we obtain 


K y? re A 
2 = A? io : = A? Co eee - 


(9.33) 
This shows that the power of the fluctuations with a continuous 
spectral density, described by the second term in the right-hand side of 
(9.32), makes up only 
K p44 
yA? 55° + A? 
of the discrete spectral line at the synchronization frequency. an 
amount which is always small if the linearization method is applicable. 
A tentative estimate of the width of the continuous spectral hand in 
(9.32) due to the fluctuations is given by 2y = ew,(2az - 1) oreven 2ew,a?, 
Then the ratio of the bandwidth of the continuous part of the spectral 
density to the effective width of the synchronization band 4,/a, !s 


x (00% (9.34) 


2a (9.35) 


For the linearization method to be applicable, it is necessary that 
the Auctuational deviations <(5A)*>/A{ and <(S¢)*> be simul! com. 
pared to unity. However, these conditions are not suflicient, particularly 
in the case of the phase when the mismatch is large and approaches 
the boundary of the synchronization band. Then the synchronization 
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can be destroyed if the phase differs from that of the synchronous 
regime by amounts much smaller than z. If 59g is such a deviation, 
a necessary condition for the validity of the results obtained above 
is that the inequality 


<(59)"> « (509)’ (9.36) 


be satisfied. Fulfillment of this condition {s hampered further by the 
fact that the phase stiffness decreases as the boundary of the synchro- 
nization band is approached, thereby increasing the amount of phase 
scatter. 

Thus we see that even when the noise level is low, the linearization 
method ceases to be applicable if the amplitude of the synchronizing 
excitation (9.26) becomes small or if the mismatch approaches the 
boundary of the synchronization band [thereby violating (9.36)]. To 
study these cases, we must use the nonlinear theory. Moreover, in the 
linearization approximation nothing at all can be said about the 
problem of phase jumps equal to an integral number of periods. In 
fact, it has been tacitly assumed that any fluctuational deviation, 
regardless of its size, is eliminated by the representative point returning 
to its original position. Actually, however, if the deviation is small 
compared to a, the representative point can approach the synchronous 
regime again “from the other side,” by describing a closed loop around 
the origin of coordinates, as a result of which the phase changes by 22. 
This is another effect that can only be understood in the context of the 
nonlinear theory, to which we now turn our attention. 


2. The Stationary Phase Distribution and the Mean Frequency 


Returning to the nonlinear equations (9.9), we assume that the in- 
equality E 
--<€6&, ie, ew, > A, (9.37) 

Ag 
is satisfied. Then the first and second equations in the system (9.9) can 
be treated separately. In fact, if (9.37) holds, the amplitude changes 
much more rapidly than the phase, and hence the amplitude manages 
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to establish an equilibrium amplitude distribution w(4|g) for every 
value of the phase g. To find w(A|¢), we use the method of the Fukker- 
Planck equation (Chap. 5, Sec. (), regarding the phase as constant in 
the first of the equations (9.9). Writing down the appropriate Fokker- 
Planck equation and using the stationary condition ii'(4|¢~)=0 for the 
conditional distribution, we obtain 


4 2A 2 
where N, is a normalization factor. The presence of the terms 
4a, EA cos ¢ in (9.38) causes the most probable value of the amplitude 
to be shifted by an amount approximately equal to (F£/2c)cosq. 
Because of (9.37), this shift is much smaller than Ao, and neglecting it, 
we obfain the probability density 


A|o)= : -A*(2 = 60s a J 

;— —_— - — = - -€xX — -—_ 

w(A|¢@ noo? r 2 N p ak“ 42 , 
(9.39) 


which coincides with (5.8). Thus, in the case of « comparatively 
narrow synchronization band, when the condition (9.37) holds, the 
amplitude distribution is practically the same as the distribution of an 
autonomous oscillator (at any noise level). 

If the noise intensily is small, ie., 


K € ew,Ag = AZo, (9.40) 


the distribution (9.39) is close to being Gaussian for small deviations 
A-—A,j: 


A 2 A? A’ OE 
w(A|{g) = — exp — (ew,— fl + Acosg>. (9.38) 
No OR 


A 
w(Al@) = y oP _ =A ~ Ao) (9.41) 


This approximation agrees with the linear approximation, iu which all 
distribution Jaws are assumed to be Gaussian. Jn fact, usine (9.37) and 
(9.24), we find that (9.22) leads to the variance 
K K 
SA) = Re. 
<(54)) & 5 ae 

Therefore the amplitude distribution oblained by the linearization 
method is actually the same as (9.41) [cf. (5.39) }. 
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We now turn to the second equations (9.9), descnbing the phase 
behavior. If (9.40) holds, the relative amplitude scatter is small, i.e., 


<(A ~ Ap)’> € AD, (9.42) 


so that A—A,<Ap) with high probability. Therefore it is a good 
approximation to replace A by Ap in the indicated equation, ynien 
gives the following equation satisfied by the phase: 


Peay a Be eae (9.43) 

Ag 
This equation can be used if the conditions (9.37) and (9.40) hold, i.e., 
if linearization in amplitude is allowed but not ijn phase. The Fokker- 
Planck equation corresponding to (9.43) is 


é ow 
w(g)=- a {[(4 ~ 4, sin ) w(o)] ar a (9.44) 


and expresses the law of “conservation of probability” 


pag 
oo 
where 
; K dw(g) 
Pe - = 9.45 
G(~) = (4 — 4, sin g) w(¢) 3A? dg (9.45) 


is just the “probability current” crossing the abscissa g. Introducing 


the notation 


2A2A 2AoA, EAgw, 
D=——-, D,=- f= ; (9.46) 
K K K 


we can write (9.45) in the form 


K 0 
G(9)= 542 (0 ~ D, sin g)w — pal (9.47) 


We are interested in the stationary phase distribution, characterized 
by the fact that w(g) does not vary in time, or equivalently, that the 
probability current (9.47) is the same for every qg. In this case, the 


SEC, 2] SYNCHRONIZATION OF AN OSCILLATOR 237 


function w(q) satisfies the equation 
d*w 
dg? 
The general solution of (9.48), containing two arbilrary constants Cy 
and Cs, is given by 


d 
ea! [(D zo D, Sin yp) w] =f, (9.48) 
do 


Au 
w(9) = C; aired ala (9.49) 
C2 
To determine the constants C, and C, we have two condilions, the 
nodicity condition 
en W(@ aan) —=w(e) (9.50) 
and the normalization condition 
an 
xo dg =1. (9.51) 
0 
To salisfy the first condition, we set C, = 0, since then 
et2n 
w(o + 22) = C, end ebet Dice | e DE Ds conway 


? 
= C, e7nP “a Mls ae a de = w(9). 
ri) 


Moreover, et2n 


w(@)m 6, ent breton [gr Bkc nent gy 


Le =] 


+2 
=C, ae aad | e D¥—Dacos¥ a) 
g 
g 
+ | @ PW Da cosW chy 4 +} 
e—2n > 


etx 


ais Ci ern eDet Ds aah 6 | - ezeD re a) | eo DY Ds cone ty 


¥ 
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etrlz 


1 
w(¢) po oo cos @ { e D¥—Dscos Y dw, (9.52) 
P 


where the normalization factor N is related to C, by the formula 
1 ash eg” 2nD 
N=- 
Cy 


Introducing the variable y=y—, we transform the normalization 
integral (9.51) into 
2n 2m 


N= [ exe} Dy + 2D, sin > sin (+ +E) dg 
0 0 


2n 


=2n e~ Pry, (20, sin sya. 


a 
Then, making the change of variable y=4(x—y) for O0<y<z and 
y=43(x—2) for 2<yx <2n, we obtain 
rf2 


= —nD , 
N =8ne | cosh(2Dy) f9(2D, cos y)dy (9.53) 


° 
= An” e~ "1.5 (D,)1_i(D,); 


where in the last step we use formula (4.453.1) from Ryshik and 
Gradstein’s handbook.? If the mismatch vanishes (D=90), the phase 
distribunon (9.52) becomes 


w() eee (9.54) 


1 
~ Qnlg(D,) 


and has the symmetric form shown in Figure 23. If D0, the form of 
the curve w(g) can be found by numencal integration. Figures 24 and 


2 J. M. Ryshik and I, S, Gradstein, op. cit., p. 239. Iip{z) is the Bessel function of 
imaginary argument and imaginary order. 
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Fig. 23. The probability density of the phase for zero mismatcll 


-3 -2 


Fig. 24. The probability density of the phase for Ds - 3. 


25 show the probability densities corresponding to the values D,=3 
and D,=10 for various values of the parameter D. ) 

The phase distribution (9.52) is essentially non-Gaussian because of 
the nonhneanty of the function D— D,sing. In fact, the motion of the 
representative point along the g-axis can be interpreted as motion ofa 
Brownian particle in an external force field whose dependence on the 
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w(y) 


-3 -2 -1 ‘e) 1 2 3 
Fig. 25. The probability density of the phase for D, = 10. 


-Op- 0, cosp 


Fig. 26. Phase fluctuations as the random motion of a mass point along a corru- 
gated inclined plane. 


position is nonlinear, i.e., proportional to D—D,sing. The external 
forces can be derived from the potential 


~ De — D,cosg, 


which is the same as the potential of a mass point (particle) moving along 
a corrugated inclined plane (see Figure 26). In the absence of Aluctu- 
ations, the representative point comes to rest at the bottom P; of one 
of the ‘‘wells.” However, it should be noted that a synchronous regime 
is impossible if there are “‘no bottoms,” because of excessive slope of 
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the plane, since then the representative point will “slide down the 
plane” without coming to rest.) The presence of candom impacts 
causes occasional] motion along the plane even when the representative 
point is “bound in a well.” The effect of the random impacts is two- 
fold: While “knocking the particle around the boltotn ofa well,’ they 
manage now and then to “kick the particle out of the well, causing it 
to slide down to the next lowest well P2, or less often to “land in a 
higher well P;.”’ In the first case, the phase increases by 27. and in the 
second case it decreases by 22. The net effect ts to catise “‘sliding”’ of 
the representative point down the inclined plane, The sliding occurs 
more rapidly the greater the slope {(mtsmatch), the shallower the wells 
{i.e., the smaller the synchronizing amplitude), aud the stronger the 
random excitation, In other words, there is a regular flow of proba- 
bility current down the slope, causing the frequency of the oscillations 
to shift in the direction of the fundamental frequency of the oscillator. 

To find the mean frequency, we average equation (9.43), obtaining 


2n 


(9) = (4 — A, sing) = [ — A,sing)w(p) de. 
0 


According to (9.45), the integrand equals 


G+ K dw 
2A2 dg’ 


and hence, : 
{g@> = 2nG, ie, (@) —w,=22G, 


since G is constant and w is periodic. It follows that 


K |-e°7"" sinh 2D 
_ = -—A L,(D.)|~?. 9.55 
{w> — a, Rip N D [Iino (D,)! (9.55) 


where we have used (9.52) to calculate the probability gurrent (9.47). 
We now examine the results which can be deduced front this formula. 

In Figure 27 we plot several curves showing the dependence of the 
{requency shift <w>)—qw, on the relative mismatch 4/4, for \arious 
values of the parameter D,. For the yalue D,=0, corresponding to very 
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Oo 


Fig. 27. Dependence of the frequency shift on the mismatch at various noise levels. 


strong noise, (9.55) reduces to 
(Mm>—- ow, 4, Le, (W> =a. 


Thus the synchronizing signal has no effect ifit is completely immersed 
in the noise, and the frequency of the oscillations is just the funda- 
mental frequency of the oscillator. In the opposite extreme case, where 
the noise is very weak, we have? 


(0 for A<A,, 


| (a? =a? for A> A,. 


J In fact, neglecting the noise term in (9.43), we obtain 


CW) — W, & 


ge d—dssing, 


and hence a synchronous regime ¢@ = 0 (i.€., <> — ws = 0) is possible if 4 < 4s 
but not if 4 > 4,. In the latter case, integration of the equation for @ gives the 
following expression for the time it takes a phase increment 49 = 27 (o accumulate: 


x dp 2x 


4t= ee EE 
3, eae Va? — A? 


But then 


5 mx —_ wo 4? oy a— 42 
(~> ™ (@)> — Os ae A 43. 
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The remaining curves, constructed by using tables of Bessel funictions 
of imaginary argument and imaginary order, all lie between the 
indicated limiting curves. Correspondingly, the mean trequency of the 
oscillations lies between the fundamental frequency of the oscillator 
and the frequency of the external synchronizing signal. 

In the case of greatest practical interest, the condition D.>( is 
satisfied, since only then are regimes close to the synclironous regime 
possible. Here, depending on the relation between A and A,, we can 
derive a number of formulas that are simpler than (9.55). If 4 < A,, we 
can use the asymptotic formula for J,, which together with (9.55) gives 


(w) — @, = 24,e77™ sinh xD. (9.56) 


If A is of order A, or Iarger, then D> ( and we can use the asyniptotic 
expansion 


Ip(D,) = a | eves eensn($ po") es enna po) 
2./3 : 
D>0, Dv=./D?—pD?>0, (9.57) 


a 
g=D(v- 5 —aretan ’). 


suitable for large imaginary values of the order p=/D, with an error of 
absolute value less than 24 ./2/|p|.4 

Formula (9.57) leads to different simplified expressions, depending 
on whether or not the mismatch A is near the synchronization band- 
width A,, or rather on the size of the ratio between (A,/A)? —1 and 
D-7!3_ Suppose that 4 is not too near A, or more exactly that 
(A,/4)? —1> D~7!3, so that v77/?> 1. Then the Hankel functions in 
(9.57) have arguments much larger than unity, and hence can be 
replaced by their asymptotic representations. Therefore (9.55) gives 


te <w> — @, = Avexp {— 2D(v — arc tan v)} 
e., 


— a D 
<w)> — w, = J A? — A* exp {-2( /0: — D* — Darceos " )}. 
(9.58) 


4 TI. M. RyshJk and I. S. Gradstein, op. cit., formula (6.464), p. 321. 
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OS 1 


al 


Fig. 28. Dependence of the mean frequency on the mismatch for small noise 
intensifies. 


The relation (9.58) can be written in the form 


_ A 
asl (-. om 


and is plotted in Figure 28. Here f is the function 


eres 


f(u) =uarccosu—/1—u?+1 (u <1), 


and has a graph lying between the lines uw and 1.57u [for u>1, we plot 
the function f(u)=1]. Formulas (9.58) and (9.59) show the rapid 
growth of the number of times synchronization ts lost as the mismatch 
or the noise level is increased. 

Next we examine more closely the range where 4/4, is of order 
unity, i.e., the range where the synchronous regime is destroyed because 
the mismatch approaches the boundary of the synchronization band. 
If 

~2/3 
Ore 
A 2 
then the argument Dv® in (9.57) is of order unity, and hence we must take 
account of the detailed behavior of the Hankel functions, transforming 
them into other cylinder functions of order +4. In this case, we hvae 
v <1, a fact which allows us to neglect the quantity ax —4+(Dv*)v’, 
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-2 -1 a 1 2 -éxM 


Fig. 29. Dependence of the mean frequency on the nismatch neur the boundary 
of the synchronization band. 


since |o| <1. Writing 4Dv° = x7/? and using (9.55) und (9.57), we obtain® 


: — 
y = 5 esate) a: Pye Ohne”) + Race? y 2 (9.60) 


where 


D\ 13 = 2/3 \2/3 
y= Sd =. += 2(2) (1 =2(" a 
3 A 3} \A 3 As 
(9.61) 


This dependence is shown by the curve AP in Figure 29. Starting from 
about x=0.7, the curve AP is close to the curve RQ representing the 
asymptotic expression 

y =x?” exp (— 2x°/7), 


When the mismatch coincides with the synchronization bandwidth 
(x=0), formula (9.60) gives 


3 
y= ae) ~ 0.55. 


3 1/3 w ; 
<m> — w, = 0.55 4(5.) = 0.55 [FE7A5 *o.K, (|. (9.62) 
, 


5. 


5 Cf. I. M. Ryshik and I. S. Gradstein, op. cit., formulas (6.493.1) and (6.493.2}, 
p. 328. 
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As the mismatch is increased and passes through the boundary of the 
synchronization band, the frequency shift continues to grow. Then 
A>A,, x<O and (9.55), (9.57) tmply® 


2 
ye —[Jia(ll) + MisxP?)*, (9.63) 


plotted in Figure 29 as the curve PS. As can be seen [rom the figure, 
starting from about —x=1, the curve PS is close to the curve OS 
representing the asymptotic expression 


y=(-x)'”, i.e., (wo) — a, = fa? — AP. 


The curves RQ and QS in Figure 29 represent the same functional 
dependence (in different variabtes) as the curves RO (z=f—1) and QS 
(z=0) in Figure 28. Hence the curve ORQS shown in Figure 28 is 
essentially accurate except in the region 


A se 
—- 1/5 0.5{ — 
a sele) 


where the curve ROS should be replaced by the smoothed monotonic 
curve RPS shown in Figure 29. Thus the theory presented above allows 
us to follow continuously the transition from the regime of “deep 
synchronization” at small noise levels (where the linearization method 


6 According fo I. M. Ryshik and I. S. Gradstein, op. cir., formulas (6.486.6) and 
(6.486.7), p. 327, for x = — |x] = ea], we have 


Hyjg (x29) mm Hyg Ce |x 972) = 2819 Hi (Lf) — Ze Sys (]x]), 
HY} (x3) = HE) (e22t | x]9/2) =v e- 20073 HE? xf) + 2023 Sra ([x]3/). 
It follows that 

(2) 


emsys EEN) (ixB/%) 4 em AH8 HV? (iB) = CF + StH) EY (x]9/%), 


and hence 


Jens F119 (ix8/2) 4 gratis Hi: (ix 3/2) |@ = |i — ential? (ty (|x]2/2) | 2 


= Fig (lx]¥) + Nig Cx]. 
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is applicable) to the nonsynchronous regime that resilts when the 
mismatch approaches the synchronization bind wid passes through it. 
In the same way, we can study how synchronization is lost as the 
amplitude of the external synchronizing signal is decreased. In this 
case, for a given mismatch, the synchronization band shrinks until 
finally the mismatch lies outside the band. In any event, as the svnchro- 
nous regime is destroyed, the {frequency ol the self-excited oscillations 
gradually changes from the synchronizing frequency «, to the funda- 
mental frequency w, of the oscillator. 


3. Large Phase Deviations and D{ffusion of the 
Number of Oscillations 


There are a number of other problems (especially those involving 
the time rate of change of the phase), where more is needed than the 
stationary solution (9.52) of the Fokker-Planck equation. We now 
consider the approximate solution of a number of nonstationary 
problems (like the one just mentioned) connected with first-passage 
times, 

If there is no nojse and if the synchronjzation condition 4< A, 
holds, then, according to (9.43), the phase takes the stable synchronous 
value sy 

@, = are sin —, 

5 
The presence of the random impacts €(f) causes fluctuational devi- 
ations from this synchronous phase. Suppose we ask how olten the 
phase deviations  —@g, =6 acquire values greater than a given value 4, 
i.e., how often the graph of the function g(f)—m,=d¢e(s) reaches a 
given level 6. In the approximation of a delta-correlated process €, (7), 
the total number of intersections of the level 4 will be infinitc, since 
each intersection is accompanied by a large (theoretically infinite) 
number of other intersections, due to Auctuational “jitter” of the 
phase. However, ifthe level 6 is much greater than the r.m.s. deviation 
a(d@), the intersections occur in clusters, as described in Chap. (, Sec. 
2. After completing such a cluster, the représentative point enters the 
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region of small deviations, where it spends a considerable amount of 
time before it returns to the level 6, suddenty producing another large 
cluster of intersections. 

The problem before us is to calculate the number of such clusters 
which occur per unit time. This will tel] us how often the phase leaves 
the region of the usual small deviations and attains the level 6. In other 
words, we want to calculate tlie amount of time the representative 
point, with a small scatter near the synchronous value, takes fo arrive 
at the level b. As we know, in the stochastic approximation, such 
problems involving first-passage times, are solved by using the non- 
stationary Fokker-Planck equation together with a zero boundary 
condition, 

To avoid difficulties associated with finding the nonstationary 
solution of equation (9.44), we use the condition 


<(59)’) <(4n - 91). (9.64) 


Here (if A>0) 4n—@, is half the distance between the ‘‘well” P, in 
Figure 26 and the nearest “vertex” Q,. The inequality (9.64) excludes 
the possibility of frequent interruptions of synchronization. It will be 
recalled that the grouping of intersections (or peaks) into clusters and 
tle counting of these clusters makes sense only if <(5¢)?) <b?, an 
inequality which coincides with (9.64) ifb~in—@y,. 

The condition (9.64) guarantees the applicability of the linearization 
method for investigating small deviations dg from the synchronous 
value of the phase. However, we are now interested in large deviations, 
and hence the problem is essentially nonlinear. Recalling the results 
found in the preceding section, we see that the case (9.64) can be 
characterized as the case where the retation (9.58) holds. In fact, it 
follows from (9.22), (9.24) and (9.37) that 


1K 1 


1) 
<(de)"? 5 At D, 


But if n—g,~ |, Say, then 


(9.65) 
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and hence (9.64) implies the inequalities 


D A; i po? A, - yaad 
el, re > VD, (3) af. , 
gnaranteeing the validity of (9.58). 

To calculate the repetition frequency of the peak clusters, we use the 
method of Chap. I, Sec. 2. Thus the following considerations have 
already been encountered, in large part. Suppose the [first intcrsection 
in a cluster occurs at time t. After a time interval Aft somewhat ex- 
ceeding the phase correlation time, the phase returns to the region 
of small deviations, and its conditional distribution has a form close to 
that of the stationary distribution. If the level & is raised sufficiently 
high above the r.m.s. deviation ¢(S@) then the mean distance between 
clusters greatly exceeds Af, and hence the mean time between first 
intersections in consecutive clusters can be regarded as tlie mez time 
it takes to go from a distribution near the stationary distribution to a 
first intersection of the level b, 

To find this time, we consider the Fokker-Planck equation 

; 6G 
Ww=- -- 


9.66 
= (9.66) 


> 
which is the same as (9.44), But now the normalization condition @.51) 
is satisfied only at the initial time, and instead, we solve (9.66) wich the 
boundary condition 


w(e,)=0 (¢,=@, + 5). (9.67) 


According to (9.67), the representative point is excluded fromm con- 
sideration as soon as it reaches the level b, which “‘absorbs”* the point, 
The number of points remaining under consideration is giveil by 


Yo 


W(y= i wdo, (9.68) 
Gb —2r 
and slowly decreases at a rate determined by integrating (9.66): 
W(t) =— G(g,) + G(@, + 2). (9.69) 


Here G(¢,) is the number of points absorbed per unit time at the level 
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b, Since we are not interested in the repetition rate of negative devi- 
ations, we must assume that the representative points are reflected 
rather than absorbed ut the negative level p=g,—2z, so that 
G(g,—22)=0. Then (9.69) becomes 


W(t) = ~ G(g,). (9.70) 


The number of points reaching the boundary in the time interval 
between t and t +dzt, i.e., taking time t to arrive at the boundary, equals 
—dW=G( q,)dt. Therefore the mean arrival time is given by 


(y= = fraM(y= | r6(omnar. (9.71) 
Q 0 


As we now show, the number of remaining representative points has a 
decay law which is approximately exponential. Because of the con- 
dition <(5~)”) <b*, the form of the distribution is practically time- 
invariant, and only the “amplitude” of the distribution changes: 


w(@,t) = w, (p) v(t) ({ w, dp = 1). (9.72) 
Substituting (9.72) into (9.66), we obtain 
iy 1 6G, 
ae oe =—A, 
v Wy 
K aw, (9.73) 
G,=(A— A, sin g) w, 5A? ap ' 


where A can only be a constant. This gives the equation 6+ Av=0, 
whose solution is an exponential, and then (9.72) becomes 


w(t) =wilge™. (9.74) 


Substituting (9.74) into (9.71), we find that the constant A is the 
reciprocal of the mean arrival time: 


A= {ty +. (9.75) 


In other words, A is just the desired repetition rate of first intersections, 
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Taking account of (9.68), (9.70) and the factorization (9.72). we 
have 


I 
A= w CPs) = Gi (Pr), (9.76) 


where (9,73) or (9.47) can be used to express the current G,{q@,) in 
terms of the probability density w,(@). We now examine in snore detail 
the distnbution w,(¢g), corresponding to the reginie of “stable decay” 
of the “‘unabsorbed”’ representative points. Such a point spends most 
of its time in the region dg ~ a(dq@), far from the absorbing level b, and 
hence its motion differs only slightly from the motion under stationary 
conditions. This means that the form of the curve 1, (g) for dp ~ a (dq) 
is very Close to the stationary distribution (9.52). However, near the 
absorbing boundary, the density w,(@) differs appreciably from (9.52); 
in fact, it has smaller values but a steeper gradient, corresponding to 
increased flow in the direction of the absorbing boundary. 

Because of the underlying condition a(dp) <b, the quantity A is 
small, and hence it can be assumed that fluctuations of all sizes 
[o(5~)S5p<4] are described by the original equation (9.48): 

2 
Tot gpl. sin g),] =0. (9.77) 
The normalization condition accompanying this equation is the same 
as before, but the periodicity condition (9.50) is replaced by the 
“absorption condition” 
W1(@s) = 0. (9.78) 


The solution of (9.77) with the boundary condition (9.78) is 
1 Po 
Ww, (9) aire dia a ae (9.79) 
Lt 
% 


obtained from (9.49) by setting 
1 
Cp=-— -, Cy, = Qy. 
1 M 2= Pp 
¢ 
In the region 5p~oa(d@), where the expression Dg+D,cos@ has its 
maximum, the integrals in (9.52) and (9.79) differ only slightly from 
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the expression , 
W. = BT edt eles (9.80) 
N, 

and hence differ only slightly from each other, as anticipated above. 


But in this region we can use the expansion 


Do + D,cos @ © De, + D, cos g, — 4057 (de) 


= ay, NG, Te 81 
(05? = D, cos g, =./D? — D’), Ce 
allowing us to transform (9.80) into the form 
‘ees 1 eds + Ds cos 1 -4VD2— D*5y)? _ e 971208 | (9.82) 


Nz 200 
Using (9.82) to evaluate N., and comparing (9.79) and (9.80), we find 
the normatization factor in (9.79): 


Po Pr 


M = Ne [ evD-Pret ay as na a aaa 
af ¢ . 


Lal La | 


(9.83) 
Then, to find the frequency (9.76) of the peak clusters, we need only 


substitute the density (9.79) into the expression (9.47) for the current 
G, (¢,), obtaining K 


~ 2AEN, | 
The integral appearing in (9.83) can be evatuated approximately, by 
using the condition D,> 1, which implies that the integrand ts apprect- 


ably different from zero only in a narrow band near g,. In fact, after 
using the expansion 


A (9.84) 


Do + D,cos p & De, + D, cos g, + (D — D, sin @,)(— — Gy») 
— 4D, cos oy (9 — 9%)’, 
(9.83) and (9.84) give (9.85) 
0 


2A5 
Av! 2na, e™ | exp {(D, sin p, — D)@ — 4D, |cos @,| 7} do 


-o7 


(9.86) 
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(cose, <0), where 
ou = De, + D, cos g, — Dy, — D, cos 


is a kind of “potential difference’ between the points p, and g,, 
relative to the energy of the noise. Here we assume that the exponential 
in the integrand of (9,86) [alls off so rapidly that it becomes vanishingly 
small for o=@, —@, (this fs the reason for extending the lower limit of 
integration to — oo), It should be noted that such a rapid decay is 
actually implied by o, <b, In terms of the complementary error 
function 
@ 
2 2 
erfex =—— |e’ dy, 
ez 


=z 


we can write (9.86) in the form 


- D, (sin p, — 2") 
Ars ~* exp 5 du + —" pil 
a @, |cas @,]) “xP oe 2\cos,| f 


D Ly2 
x erfc {in @, — 2) (; = i (9.87) 
b 


where «= D/D, 
The most inaccessible value of the phase 


D 
Q, =N—Qy =X — are sin 7 (9.88) 


i 


corresponds to the “‘vertex” Q, of the potential function (see Figure 
26), and hence the maximum potential difference is 


— D 
Su = 2D, cos @; — D(z — 94) = 2./D?2 — D? — 2D arc cos F 
(9.89) 


At the point Q,, the potential function has the samc second derivative 
as the “lowest point” P, (where p=Q,), but with the opposite sign 
(D,cosp, = — 9%). Setting ~,=@, in (9.87), we find that the phase, 
which usually stays near g,, occasionally grows and reaches the 
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“vertex” Q,, with frequency 


+, ome 
A= *e “cos, 
T 


1 _ en 
~ | JaP= Bi exp |~2( DED? ~ Darecos >}. (9.90) 
tt D,}{ 


Once having arrived at the vertex Q,, the representative point can slide 
down either side of the “‘hill’”’ with equal probability. Thus, in half the 
cases, the point will slide back to the original well P,. On the other 
hand, in the remaining cases, the point will “‘get over the top” and 
slide down to a new well P,, lying further downhill, and as a result the 
phase will acquire an increment of 22. Obviously, the phase jumps in 
the forward direction occur with a frequency G, equal to one half of 
(9.90): 


1 — D 
G, = 5 V 45 - A7exp {~2( Jor 0" — Dare cos (9.91) 
iA 5 


Besides “forward” phase jumps, there are also “backward’’ phase 
jumps, which decrease the phase by 2” and occur with frequency G_. 
To calculate G_, we must choose a value of yg, corresponding to the 
next vertex on the “uphill’? side of g,. This value is —z—@,, and 
instead of (9.91) we get 


1 +; D 
G_ og Az — A* exp ‘~ 2 JB? ~— D? +(x-arecos >) 


s 


=e 9G, (9.92) 


In the expressions (9.91) and (9.92), the determining factor is the 
exponential e~*“, which resembles the Boltzmann distribulion. The 
meaning of this factor is perfectly clear: The higher the barrier, the 
more difficult it is to overcome. Which of the vertices on the two sides 
of gy, is higher depends on the sign of the mismatch A. If 4>0, then 
the inclination jis in the direction shown in Figure 26, causing ‘‘for- 
ward’? jumps to occur more frequently than “‘backward’’ jumps 
(G,>G_). If 4<0, we have the opposite inclination, and “backward’’ 
jumps predominate. 
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The difference between the expressions (9.91) and (9.92) gives the 
average uncompensated flow causing the mean fiequency of the self- 
excited oscillations to shift towards the fundamental [requency of the 
oscillator, i.e., 


{w) _ @, =2n(G, aa G_) 
2 D 
=f A? — A?(1— er) exp | -2(./D! — D° — Dare cos al 


(9.93) 


This formula implies (9.56) as a special case for )<D.. and also 
(9.58) for D> 1. Interpreting (w> —w, as the difference 


2n(G, — G_)=2nG,(1 —e° 7"), 


we observe that (9.55) is in the form of a difference between two terms 
differing by a factor of e~ 2", just as in (9.91) and (9.92). Therefore it 
is natural to identify minuends and subtrahends separately. obtaining 
the formulas 


Gp See a As abe iy 
eC OALN dnt 2Az REE 
<— (9.94) 
~2aD —-anD marty | 
G_=e G, ~ An? 2A2 é lin(P,)I 


which generalize (9.91) and (9.92). 

It follows from the above considerations that from time to time the 
phase jumps forward or backward by a period. The durition of cach 
jump is of order , 1 , 

—|In~— InD,, (9.95) 
A, a A 


while the average time between jumps is much larger, of order 


Therefore the jumps can %e regarded as statistically independent. 
Examining the number n of extra or missing periods in the generated 
signal, as compared to the synchronizing signal, we have a model 
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reminiscent of a one-dimensional random walk, i.e., at random times 
the number n undergoes random jumps equal to either +] of —{. 
Because of the operation of the central limit theorem, alter a time t 
greatly exceeding the average interval between jumps, the random 
variable m approaches a Gaussian distribution, with mean and 
variance 


(ny = 2G, —G_)t, Dn=(G,+G_)t=Dot. (9.96) 


In fact, the number of positive jumps has mean G,t and variance G,t, 
while the number of negative jumps has mean G_f and variance G_t. 
Moreover, since the positive and negative jumps are independent, the 
means and variances add algebraically. The total number of ascillations 
after time t is obtained by increasing 2 by the nonrandom number of 
period w,t/27, 

Thus the number of oscillations in the generated stgnal undergoes 
diffusional “‘spreading,”’ with diffusion coefficient 


K 
cosh 2D{J,,(D,)I~ 7. (9.97) 


1 
Do=G,+G_=-; 
aaa 2n* 2A2 


The same is true of the phase, which is proportional to the number n 
and hence has a diffusion coefficient (27)? times larger than that of n. 

It follows froin (9.93) and (9.94) that the diffusion coefficient (9.97) 
can be obtained by multiplying the [frequency shift (2x)~' (<w>—,) 
by coth 2D; if D>1, this gives just (2x)"'(<w>)—w,). Thus the be- 
havior of the diffusion coefficient can be investigated by using the 
formulas and graphs of the preceding section. 

Clearly, the diffusion of the number of oscillations increases with 
the noise intensity. For zero mismatch, (9.97) leads to the dependence 


1 K 4, 1 
~ 4n? A2I2(D.) 2n? DJId(D,)’ 


Dg (9.98) 


as shown in Figure 30, 
In cases where the relations (9.91) and (9.92) hold, they can be 
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Fig. 30. Dependence of the diffusion coefficient on the noise intensity for zero 
mismatch. 
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Fig. 31. Spectral density of the signal generated by a synchronized oscifator in 
the presence of noise (<w> — ws ~ Ae~™, we — we ~ 4s tanh wD). 


added to give 
1 ee 

Dg Saas ~A() te") 
ria 


oe D 
x exp {- 2(/03 — D* — Dare cos _ )f (9.99) 


As the mismatch is increased, the amount of diffusion increases Inono- 
tonically and quite rapidly, as can be deduced from Figure 28. by 
writing z in the form 


Ly 2xDe_ sion) 


= —]1 : 
Z 2D. n ra 
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As for the specira] density of the generated signal, it must first of all 
contain a discrete spectral line of frequency w, due to the presence of 
synchronization. But (w)#a@,, and hence the total spectral density 
has a continuous component, whiose “center frequency” w, is shifted 
from the discrete line at w, by an amount of order A, tanh 2D, as 
shown schematically in Figure 31. The continuous component has 
bandwidth of order A, and total power of order Aje~™", while the dis- 
crete component has power of order Aq/2.” : 


4. The Case of a Large Synchronizing Signal 


The considerations of the preceding two sections were subject to the 
condition that the amplitude £ of the external synchronizing signal be 
small, as expressed by the condition (9.39), but in practice £ is often 
increased, in order to achieve a synchronous regime more quickly. 
Therefore it is of interest to study synchronization when the external 
amplitude Z is comparable to €Ay- The small deviations from the syn- 
chronous regime corresponding to this case have already been con- 
sidered in the linear approximation in Sec. {. However, the nonlinear 
problem is very complicated, and we shall] solve it by introducing a 
simplifying assumption of a different kind, i.e., by assuming that there 
is no mismatch (4=0). This case is of greater practical interest than 
the case of nonvanishing mismatch, since it is optimal in the sense of 
leading to the most stable synchronous regime. 

It is now no longer appropriate to start from the equations (9.9). 
Instead we base our calculations on certain equations equivalent to 
(9.9), which can be derived as follows: Suppose we transform from 
polar coordinates A and ¢ to rectangular coordinates 


z,=Acosgy, 2,=Asing (9.10!) 


in a phase plane rotating with angular velocity w,. Differentiating 


7 The details are given in the Supplement, p. 273. 
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(9.101) with respect to time and using the equations (9.7), we lind that 


ee 

Z,=Acos@ — Agsing = “S(t - ae )a 
7 ; 
+ — Az, + Hy) SiN @,f, 
Z,=Asing + Agcos¢@ 
EWy zt + zi 
= $( - Als + Az, + mycosmt. (9.102) 
2 As 

The fluctuational terms w,y sin w,t, w7 Cos Wf appearing in (9.102) can 
be simplified much more easily than those appearing in (9.7), since the 
arguments of the trigonometric functions are independent of «, and 
hence of y. If the correlation time of the process 7(t) is much smaller 
than the amplitude and phase relaxation times, then the correlation 
function 


3 


(@,y Sil @,f° Wn, Sin @,(t + T)> = Fy <nn,> [cos wt — cos , (24 + 1)] 
can be replaced by 


i 2 
5(r) i = <nn,> cos wt dt = K6(r), 


—-—2 


and similarly for the second term @,7 cos wf. As a result. we obtain 
the system 


(9.103) 


2 
£0) Z,+2Z 
22 = se = : 2 ‘es + Az, + €>, 


where €,,¢, are independent, identically distributed Gaussian random 
functions, with the properties (9.10), i.e., exactly the same as the 
functions €,,¢2 in (9.9). There are other ways of proving the equiva- 
lence of the systems (9.9) and (9.103). 

For 4=0, the system (9.103) describes the motion of a Browman 
particle in a potential force field. In fact, in this case (9.103) can be 
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written in the form 


oU ecu 
seas ean Z2=—-—- +62, (9.104) 
724 4-32 
where 
2 2 2 2 
EWo 24 + 23 oy t+ Zo w,E 
Ulta) = O° aE 1) 22-2, (0.105) 


is the potential function shown schematically in Figure 32. The 
Fokker-Planck equation corresponding to the system (9.104) is 


@ (dU d (dU K (a*w  a?w 
arene (races + -—[— wt — -=s + > }. 9,]06 
. Oz, (= ") a ) (33 : 


The corresponding stationary distribution must therefore satisfy the 
equation 


aw aw 2 8 /aU 2 @ feu 
—5 + stoz-le-ws+ sli w =Q, (9.107) 
dz; 62; K 0z,\dz, K 6z,\éz, 
with solution 
a 
w(21,22) = Te aU(k (9.108) 


if we require, as usua!, that the probability density w vanish at infinity. 
Just as in the one-dimensional case, (9.108) has the form ofa Boltzmann 
distribution. 

The stationary distribution (9.108) can easily be written in terms of 
the amplitude A and the phase ¢. In fact, since dz,dz,= AdAdg, it 
follows from (9.105) and (9.108) that 
Pe ee sa 1/4 Cele 9,109 
=— ———-{ ---, —l1]— + —- Acos#>. ; 
w(4,o) =a exp) Sh 5gs a t+ Bos ly) 


To obtain the univariate amplitude or phase distribution, we need only 
integrate (9.109) with respect to the other variable. Thus, integrating 
(9.109) with respect to @, we find the stationary amplitude distribution 


(A 2n | EW, { A” \4! j wE 
wlAd= y API Kaa 7 tia ): 
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where Ig(z) is the modified Besse! function of the first kind, of crder zero. 

The case of greatest practical intcrest occurs when the noise is not 
Strong enough to prevent anything resembling syncltront7ation. Then 
the oscillator operates under essentially synchronous conditions, al- 
though occasionally the noise destroys the synchronous regime, The 
inequality 


<€1 (9.110 
EWg Ag ) 


guarantees that the departures from the synchronous regime are not 
excessive, and the rest of our calculations will be based on the as- 
sumption that this condition holds. Then most of the probability 
(9.108) is concentrated near the synchronous values =, =.4,@,. 2, =9, 
and the standard deviations o(z,),o(z,) are smat!{ enough to be treated 
by the linearization method, leading to the expressions (9.22). Under 
these conditions, we can use the expansion 


U(z,,72) = Up + $5(z, — Aga,)? + 40’23 
where 


> Gai = ai. (2.111) 


For the usual] small aoe this leads to a Guussian distribution 
ibs sey 5 aN 
w(z,,z,)= —e RK exps— — (z, —Agat,;)? — 23>. 
(21,22) N P| ne 1 off] Ko 


where it is a simple consequence of the normalization condition that 
1 

N° 

As in Sec. 3, we now consider the nonlinear problem of determining 
the frequency of interrnptions of synchronization, which lead either 
to the Joss or the gain of a period. Here we are interested in the case 
where such interruptions, occur rather seldom, i.e.. where the con- 
dition (9.110) guaranteeing ‘‘satisfactory synchronization” holds, so 
that ¢(5A)?) <Aé, ¢(d¢@)”> «1. If A, is not too large. the potential 
surface y= U(z,,z,) corresponding to (9.{05) is cup-shaped with a 
circular gutter at its bottom (see Figure 32). wherc the gutter is 
bounded by a loop around the origin and tilts downward in the 


@ 20K — vee (9.112) 
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22 


we 2) 


Fig. 32. The potential surface y = U(zi,z2), shaped like a cup with an Inclined 
circular gutter at the bottom. 


direction of the z,-axis. The lowest point of the gutter has coordinates 
z, = Aga, Zz, =0, and corresponds to the synchronous values of the 
amplitude and phase. A phase jump occurs whenever the “fluctuational 
impacts” cause the representative point to move upward along the 
gutter until it reaches the highest point P, of (the bottom of) the gutter, 
afterwards sliding back into the original “well” from the opposite side. 
The highest point P, of the gutter has coordinates z; = — Aga, Z, =9, 

and lies on the opposite side of the origin from the lowest point (with 
coordinates z, = Aga), 2, =0). 

It is reasonable to expect that the frequency of phase jumps will 
depend on the difference between the heights of the points P, and P,, 
which we now determine by finding the coordinates of P, and P,. 
Both points are extrema of the expression (9.105) with z.=0. Thus, 
differentiating (9.|05), we obtain the equation 


2A 
ewe. 20 (as. ass =); 9513) 
EW o Ag 2Aq 


whose roots a, and a, determine the position of the points P, and P,. 
The substitution a= —(3p)7!/?y reduces the cubic equation (9. {13) 


to the standard form y? — Spy +2=0, 


where 
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The roots of this equation, arranged in the order y,>y,>0>),3 and 
tabulated as a function of 3p, are available in the literature.® Therefore, 
given any value of the quantity ew)/A,, we can lind the amplitudes 


. a (9.114) 
Az = Aga2, a= teand %% 


corresponding to the paints P; and P,, as well as the values of the 
potential (9.|05) at these points: 


4 
U, = le 3 ay aj _ neem 
2 4 2 — Ear 


(9.{15) 


EwAal (1\" yi 
= —3 +2 
sal (2) ass 


The problem of calculating the number of interruptions of syn- 
chronization is essentially that of calculating the number of times the 
representative point intersects the haff-line or ray =; <0 (z,=0). This 
quantity is given by formula (9.76), except that now 


A= Gils 


(b stands for “boundary”) is the probability current arriving at the 
half-jine z, <0. Since here we are concerned with the two-dimensional 
case, the probability current corresponding to equation (9.106) is a 
vector with components 


aU, K dw cU K cw 
— —--. } —_— —-. me, 
2 


dz; 262, éz, 


8 See e.g., E. Jahnke and F. Emde, Tables of Functions with Formutae ond Cui ves, 
fourth edttion, Dover Publicaticns, Inc., New York (1945), Addenda. p. 20 If. 
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Therefore the current of representative points ‘absorbed’ by the 
half-Jine =, <0 from one side (from above, say) equals 


dz,, (9.116) 


since w,|,=90.? 

By analogy with Sec. 3, the probability density w, appearing in 
(9.116) differs only slightly from the stationary distribution (9.108) 
in the region where most of the probability accumulates. However, 
its behavior is quite different near the “absorbing” hallf-line, since it 
must obey the zero boundary condition 


w, =9 for Zo <9, z,=9. (9.117) 


Between the absorbing boundary and the region of maximum proba- 
bility, the density w, (z,,22) stiff satisfies (9.{07). To find the current 
(9.(16), we must find a solution, even if only approximate, of equation 
(9.{07), subject to the boundary condition (9.{{7). 

To this end, we fook for a sofution in the form 


Wy (21,22) = 0(z4) Wa (21,22); (9.118) 
where the function 


o(2s) = exp} =F u(e0} (9.119) 


satisfies the equation 

67» = =2 @ f/4U(2,,0 

@z} Kdoz,\ dz, 
Substituting (9.{[8) into (9.{07), we obtain the following exact 
equation for the function w.(z,,z,): 


aw, 2 d (aU a*w, 2 av ‘ 2 dU\éw, 

ger, =. —<—s - Ww = — as ———— - 8 ———s 

dz3 a K 02z,\éz, zt v dz, K éz,/éz, 
w,2 0/24 

= K is [ U(z;, 22) U(z,,0)] 9 


Oz, 
(9.120) 


° Here 
w(21, Zz, f) = wi(zy, 22) e~ 44, 
as in (9.74). 
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Near the boundary, the expression on the ight takes smafl values, 
In fact, according to (9.117), 
W2(2,,0)=90 for 2, <0, (9.121) 
and hence 
W2 (21,22) = B(21)22 + O(22) (21 <0). (9.122) 
where B(z,) is some function. Substituting (9.{22) into the right-hand 
side of (9.120), we obtain 
0? lie: Z 0 
=—B8 s + O(23), 9.(23 
mK z axle vs] (z,)z2. + O(22) ( ) 
where 
B(z,) = d’B(z4) 2 8U(,.0) dp(z,) 
: dz? K @éz, dz, 
because of (9.120), (9.119) and (9.122). sak aly of (9.125) gives 
dw, 2 0U 
<a 
dz, K éz, 


; (9.124) 


= 2 = B(21) - Bes), ; (9.125) 


where the constant of integration has been chosen to be /}(z,). in 
keeping with (9.122). Integrating the first-order differentia! equation 
(9.{25), with the boundary condition (9.{2!), we find that 


2[ 4 
W2(24,22) = erwin f el g(e,)— B(21) + [ass, (9.126) 
0 
The integra! appearing in (9.126) can be evaluated by using the 
relation 


EW, 227 + 22 
U(z4,22) = U(z,,0) _ A( mae rea E 
: 0 
2 
Ew 
= U(z,,0) —- a1 — aya + O(23). 
, 
implied by the form of the potentiaf function (9.105). Tlerefore, 


introducing the notation 


(c= 2(1- FZ) (2? < Aj). (9.127) 
Ao 
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we have 
2 2 
w2(z1,Z2) = exp, — re U(z,,z2) + Ps U(z,,0) 
2 


, Bz3 
x fews(p — == + .-) de 


0 


~ esp] - pLU(21,22) - u(e.o} [(F = a + ) 


if az,>1. (9.128) 


It follows from (9.118), (9.119) and (9.128) that the density w, is given 
by the formula 


x[B(z B(z 
w, (21,22) = ii Kan ( D, + lee 
bai m B(21) |-2u/x 
2 « (21) 
in terms of the function f(z,) describing the gradient of the proba- 
bility distribution near the boundary. The last approximation antici- 
pates the fact that we are only interested in the region where 


B 
4< : (9.130) 
a a 


(9.129) 


[see the discussion below formula (9.134) ]. 

Thus all that remains is to determine the function f(z,). This is the 
key quantity, since the desired frequency (9.76) can be expressed in 
terms of 8(z,) by using (9.116), (9.118) and (9.122): 

0 


K 
A= 5 | »(z,)B(z,)dz,. (9.131) 
To find B(z,), we use the fact (already mentioned) that the density 
(9.118) is close to the stationary distribution (9.108) in the region 
where most of the probability accumulates. Comparing (9.108) and 
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(9.129) [with only the first term retained], we see at once that 


B(z,) = f: nee (9.132) 


Therefore, using (9.131) and (9.127), we finally obtain the following 
formula for the rate at which the representative point intersects the 
half-line z, <0: 


1 | eof uewo} ft 4 
A=— exp; — — U(z,,0 l=" dz\.. (9.133) 
N K (z, ) Ae 1 


z1<*0 


Because of the exponential factor in (9.133), the contribution to the 
integral comes mainly from the narrow region [near the point P,= 
(— A_a2,0)] where !® 


2 2 
4 Ul21.0) — & U(— A020) ~ 1. (9.134) 


The behavior of the potential function (9.115) near P; can be approxi- 
mated by 
U(z,,22) = U, + 462(z, + Aga2)” — 46423. (9.135) 


where the quantities 


Eg 


w 2 
b= 83a 1), d= O8(1-ai)>0 9.136 


play the same role for the point P, as the quantities 6 and 6’ play for 
the point P, [cf. (9.111)]. Using (9.135), we write (9.134) as 


™ 


5 
gz + Anda)? ~ 1. (9.137) 


10 Because of (9.135), this justifies the approximation 


A BS u e 2a f er Onley + Agdg)t/K 1 =5 zi dz 
N NO Ae 


z1<0Q 
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It follows from (9.135)}-(9.137) that if z; ~ Apo, then 


B 2 éU(z,,9) B B Fama 
Bw —, 4 =. — Et fe + Apa) -- 
Ait kK Gz, Ag As Ket 002), Ag 
55 EW, 
AB fe Bw ewe 
At As k ~ AL AQN K 


and hence, as anticipated by (9.130), 


B : K | K B 
a egos —_ + 3 <€-, 
ot a \ew Az £09A5 a 


where we have used (9.127) and (9.110). It is not hard to see that the 
whole calculation depends on the assumption that 4,/ew, is not too 
small, since otherwise the variation of the factor 


in (9.133) cannot be neglected. 
Substituting (9.135) into (9.133) and integrating the result between 
infinite limits [this is possible because of the condition (9.110)], we 


obtain 
epee a2 ¢~ 2K = ape = 2U3/K 3 
c= ae Ji=aj NVO (hee) 


Using the expression (9.112) for N, we find that 


Foe g ae 86°32 20: UayiK (9.139) 
fa 52 
where 
55'S,  [twW\7 3a? 
nots = (8) Sat a it (at — (1 - a). 


As the amplitude of the external signal and hence £/26A, is in- 
creased, i.e., aS 3p is decreased, the point P, (see Figure 32) rises higher 
and higher, and eventually disappears. If the external amplitude is not 
too large, so that the saddle point P, lies below the origin O (U,<0), 
the vast majority of interruptions of synchronization take place along 
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the bottom of the gutter through the point P,, as described by for- 
mula (9.138), However, for the value 
E 4, 
3p=3.8, ie, --. =— =0.135. 
2£Ay Ey 

the point P, has the same height as the origin (U,=0). and then we 
must allow for the possibility of the representative point intersecting 
the half-line z; <0 (z.=0) near the origin. Whereas previously (he anti- 
synchronous phase g=2z was achieved most often with amplitude 
Adz, it is now achieved just as often with very smal! amplitudes. For 
3p <3.8, the vast majority of interruptions of synchronization occur 
with very small amplitudes and have the following appearance: The 
amplitude of the oscillations decreases in a Aluctuational fashion until 
it almost vanishes, and then after a certain amount of time it builds 
up again to its previous values. A study of the oscillations during the 
interval of small amplitudes reveals that in some cases there is a 
missing period or an extra period. But this anomaly is not very notice- 
able, because of the smallness of the amplitudes at the moinent of 
interruption of synchronization, and hence such interruptions of 
synchronization are less important than those occurring with ampli- 
tude Apay. 

Two kinds of interruptions of synchronization are possible for 
3<p<3.8, both through the amplitude A,a, and through small am- 
plitudes, with the latter predominating. As the synchronizing: aimpli- 
tude is made even larger (3p <3), there is no longer any “preferred 
amplitude” at the moment when the oscillations have the antisyn- 
chronous phase, since (9.113) now has only one real root. and in fact, 
the smaller the amplitude, the larger its probability. The “last” pre- 
ferred amplitude of the antisynchronous phase occurs for 4p 3 and 
equals A, =Ap/4/3= A,/2, but is effectively masked by the mass of 
interruptions occurring with other amplitudes. 

We again consider the case where 3; is not too small and the anti- 
synchronous phase occurs as a rule with ainplitude 4,=A,a, 
(Ap > Az> Ap//3, A, > Az > A;/2). Once the phase g=x is achieved, 
in half the cases the phase subsequently “‘falls back”’ to the synchronous 
value, while in the other half the phase “‘goes over the hump” (the 
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saddle point), thereby traversing a loop around the origin and ac- 
quiring an increment of 22 as it returns to the synchronous value. 
Thus the frequency of phase jumps equal to 2z is given by A/2. 
Similarly, the frequency of phase jumps equal to —2z is also given 
by A/2. Therefore the total frequency of phase jumps of either sign 
equals A. Introducing a diffusion coefficient for the number of periods 
as in Sec. 3, we obtain the formula 


1 [55'S 
Do =A= ae e Aer te (9.140) 
2 


generalizing formula (9.99) [with 4=0] to the case where the syn- 
chronizing signal has large amplitude. 

The number of interruptions of synchronization increases rapidly 
as the mismatch is made different from zero. We conclude this section 
by giving a brief approximate treatment of the case of large mismatch 
A~ A,. In this case, the points P,; and P, no longer lie in the yz,-plane, 
and in fact their positions can be determined by setting z; =Z,=—0 and 
&,=&,=0 in (9.103). In Sec. | we derived formulas (9.11) and (9.12) 
determining the polar coordinates r= Aga,, p=, Of (the projectionof) 
the point P,. The coordinates a2, g, of the second point P, can be 
found from the same equations, bul P, does not exist if (9.12) has 
only one root. 

On p. 228 we considered the radial and azimuthal ‘‘stiffnesses” at 
the point P,, i.e., 


£ 
fe Gaal), 2S > 


; (a ~1) 


[cf. (9.16)]. The corresponding radial and azimuthal coefficients for 
the point P, (if it exists) are given by the analogous expressions 


Ew Ew 
5, = ~7 (3a; ~1), 6,= ral ce) 


which agree with (9.135). To generalize (9.140) to the case of nonzero 
mismatch, we must first find the new values of a,,a, and then substitute 
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them into the formulas for 6, 6’, 6, 65. Moreover, the line integral 


2 (<2, dz, + (2,) dz2). 
P 


previously equal to the potential difference U, — U, [ figuring in (9.140)], 
now becomes Pp; 


Ur- Uj +4 | (en dz — 2, dz3), (9.141) 
Py 
after taking account of the terms —4z, and Az, in (9.103). 

An exact solution of the problem for nonzero mismatch is yery 
difficult, because of the nonpotential character of the “‘velocity fields” 
(2, and (2,>. Here we sidestep these difficulties and give only a very 
approximateestimate, sufficient for practical purposes. Although theline 
integral in (9.141) actually depends on the path of mlegration, we set 


(A2.07) 


z 
[te dz,—2,dz,)=— | A’ do 
(Ale 1) 
= — Ai,(92 — @) = — Aoaya2(92 — Q;). 
where z,=A cos @,, 22=A cos , and A,, is an average value of the 
amplitude, estimated as the geometric mean of A, and A3. Similarly, 
going from P, to P, in the opposite direction, we find that 


(9.142) 


[@ dz, — 2, dz,)%— Aga,a,(2n— 9,491). (9.143) 


Next, using (9.142) and (9.143) to replace U,—U, in (9.141). where 
aes =2G_, we oblain 


5'54,6 ) 2A. 
G,= “ exb 4 — = (U; =U) += K > Aoaia2 (2 - 91) 


InN 8, 
1 {8s 556 

=-- exp <— £(U;— Uy) + aya 2nD 
2n roe 


—a,a,(x-— py+ ooh. 
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A similar calculation of G_, based on (9.143), gives 


55 5 “ IA 
G_= 3, exp qc (U2 = Ujyes x 108142 (28 — 92 + 91) 


_i So o 2 


— 4,4,(% — 2+ 0) 0}. 
But as we already know, 


Do =G,+G_, <w> — oO, = 2n(G, —G_), 


which leads to the following formulas corrected for (he effects of 
nonzero mismatch: 


5 ee é 
=- | —~ cosh (a,a,7D) 


2 
x exp  — Pals —U,)—a,a,(" —g, + 9;)D>, 
5556 
<w> re sinh (a,a,7D) 
2 
2 
exp — pe U: - U;) = a,a,(x — GP + oo}. 


(9.144) 
In particular, we now have 


<w> — Ws, 
~——_—- = tanh{a,a,nD), 
2nDo ( 12 ) 
instead of the formula 
w>—- 
SO = tanh xD 
2nDpo 


implied by (9.94). The formulas (9.144) generalize formulas (9.93) and 
(9.99), to which they reduce for 4,/ew,) <I. 
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*® We now clarify the remarks made at the end of Sec. 4, concerning 
the spectral structure of the signal generated by a synchronized oscil- 
lator. Suppose the phase jumps in the forward direction occur at times 
ft; and have a Poisson distribution with density G,. Let the analogous 
quantities for the backward jumps be /, and G._. Then, neglecting 
small phase fluctuations, we have 


@()= LF (t-t/)- LF (t-4), (9.145) 
i i 
where F, and F_ are certain “‘pulses”’ (see below) such that 


I F, (0) d@ =2n. (9. 146) 
Let 
Ex () = Ld(t— t*) (9.147) 


be the corresponding ‘“‘random density functions” [ecf. (1.6.21)], 
described by the generating functionals 


Li [o(t)] ~exp} [ Gyv(f) a (9.148) 


[cf. (I.6.31)]. Then (9.145) implies 


g(t) — (0) = [a | [F,(t—s)&, (s) — F(t —s)€_(s)] ds. 


(9.149) 


By analogy with (I.7.16) and (8.32), the correlation function of the 
generated signal can be written as 


(xk. = 4A2Z Re Ce (ot olO)— teary (9.150) 


The next step is to substitute (9.149) into (9.150). Together, (1.6.24) 
and (9.148) give 


(cx | u(s)é(s) ash) = emp G. i [e** — 1] ash. (9.151) 
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It then follows from (9.149) and (9.150) that 


wo 


xx) = 4A5 Re [exn}c. eT UF tt —spae n | ds 
7 - (9.152) 
oa i) eee 7 | ds — ios, +20. 


—@® 


Here we regard the functions ¢,(f) and €_(r) as statistically inde- 
pendent, a natural assumption in the Poisson approximation. The 
spectral density is now found by taking the Fourier transform of 
(9.152). By analogy with (1.7.13) and (8.88), we have 


S[x;@] = $495, ( —,), (9.153) 


where 
S,(v) =2 [+ (t)f_(t)e dt = 4 Re 1 [te (ct) f_ (rt) e'* anh (9.154) 


[cf. (9.157)] and 


- ¥IfF(e~ spat 
fats) ~exp {ee { | =1] ds, +20. (9.155) 


—@ 
The functions F, can be determined from equations of the form 
8 
F, (0) = 4 — 4, sin [ Fees’, 


obtained by averaging (9.43), but qualitative estimates can be made 
by using the approximation 


2n 

-- for 0<@<Tp, 

F,.(0) = F_.(8) = (1 : 
Q otherwise, 

where 


To™~ -- In D, 
s 
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[cf. (9.95)]. Then 


F S+T for —tr S58 ~—%4+T, 
2n t for —-rattrss<0. 
[Fee-9ar= .- ? 
T Jt—S for O<st., 
by 0 otherwise 
if t<Tp, while 
: St+tT for -—tTr<s cd. 


2n t for O<s<t—T, 
[Fee-9a=2 ° OSS : 
tT J)t-S for t-to<sKr, 


: 0 otherwise 


if tty. Substituting these functions into (9.155) and integrating with 
respect to s, we obtain 


f+ (t) = exp {26 f (em a t)as + Gy (t— 5 Ca = i) 
Q 


for N<Trt, 
to 


Sx (t) = exp \26, | Cit _ 1) a| for r>TQ; 


0 
and hence 
f(r) f- (2) 
2 2 
= exp (6, + | sin shte + (t) — t) cos uae tT | 
n "TT To 
2 
—i(G,—-G_) ki (1 — cas =) + (t, — t) sin =I 
rs To To 
for Ott, 
fi (OD Sf-() = exp {— 2(G, + G_)t)} for te. (9.156) 
’ 


The function f, (z) f_(t) is continued into the region t<0 by using the 
formula 

fe(-—9OF-(-D=SF OLA, (9.157) 
implied by 

Ce 19s) Fi@(0)y = Celtts)—F0(0) ; 
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The presence in f, (t) f_ (rt) of imaginary terins (and hence of terms 
odd in ft) testifies to the asynimetry of the spectral density S,(v) about 
y=0, i-e., of the spectral density S[x;w] about o=w,, stemming from 
the fact that G,—G_ is nonzero, It is clear from (9.154) and (9.156) 
that S[x;«] has a delta-function peak 


nAg e 19+ *5-"5 (uy — w,), 
which contributes an amount of power 
COS EA ees, 
The remaining power 
(x7), = Cx") — (x7) = 
= FAR[L — e 28G+ #5-9] we Ad(G, + G_)t) ~ AQ en ™ 


is the total power of the continuous component of tlie spectral density, 
whose bandwidth, according to (9.156), is of order 


eA. 
To 
Let w, be the “‘center frequency” of the continuous component, 1.€., 
its center of gravity. Then the mean frequency (w), equal to the center 
of gravity of the fofa/ spectral density, is a weighted average of the 
discrete and continuous components: 
(w> = [1 —2(G, + G_) to] w, + 2(G, + G_) tom, 
=, + 2(G, + G_)t9(w, — ,). 
Using (9.93), we find that the continuous component is shifted from 
(ie discrete component by an aniount 
w> — w, xnG,—G_ 
w.—-wW,= a Se me teh ae eS A, (anh xD 
2t9(G4 +G_) 1G, +G. 


as asserted on p. 258. % 


CHAPTER 10 


Parametric Oscillations 


The adjective “parametric” is applied to phenomena and processes 
which are described by differential equations with variable parameters, 
more exactly, whose differential equations contain linear terms with 
time-dependent coefficients. The equations as a whole can be either 
linear or nonlinear, and oscillations can be excited in the system by 
both regular and irregular oscillations of the parameters. I1 is more 
convenient to study the conditions for excilation of such oscill:tions 
by using the example of a linear system, but nonlinearity must be taken 
into account in order to calculate the amplitude of the oscillations. 
However, even the linear theory of parametric excitation is intimately 
connected with the theory of nonlinear oscillations. both tit subject 
matter and in methodology. It is for this reason that we follow tra- 
dition and study parametric oscillations under the heading of tone 
linear oscillations. 

As a very simple example of an electrical systein with sariable 
parameters, consider (the oscillatory circuit shown in Figure 23, where 


C(t) L(t) 
Lh scidliemes 


Fig. 33. An oscillatory circuit with variable parameters 
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the capacitance C and the inductance & vary in time. The oscillations 
in this system are described by the equation 


PHO (NP +k(Ny =O, (10.1) 


where y is the current or voltage tn any element, and k(t)=1/LC and 
26(1)=R/L are parameters varying in time, because of instability of 
the inductance and capacitance. This instability can be produced either 
by spontaneous internal fluctuations or by some externally applied 
variable voltage. 

Various special effects may be used to produce controlled variation 
of the parameters, e.g., the dependence of interelectrode capacitance 
on voltages applied to other grids, the dependence of the magnetic 
permeability of ferromagnetic materials on the magnetic field intensity, 
and so on. Parametric systems with controlled frequency changes 
resemble frequency-modulation systems, from which they differ only 
by the rate of change of the frequency. An important class of para- 
metric systems consists of mechanical systems, e.g., a pendulum 
executing horizontal oscillations while the point of suspension under- 
goes vertical displacements, transverse oscillations of a hinged beam 
or of a fastened string subject to time-dependent forces, etc. 

As already noted, the character of the parameter changes may be 
either regular or irregular. Mixed cases are also possible, where 
fluctuational excitations are imposed on regular (say, harmonic) 
oscillations. Here we restrict ourselves to the case where the intensity 
of the parameter changes is small, so that the oscillations are close to 
being harmonic. As applied to the last term in equation (10.1), this 
means that k(1) is the sum of a large constant term and a small variable 
term, 1.€., 

k(th=ko + ek,(), (10.2) 


where ¢ is a small parameter whose presence allows us to use the 
asymptotic methods considered earlier and to achieve accuracies of 
various orders in &. Using the first approximation (of the first order 
in €), we can investigate the fundamental parametric resonance, in 
which the system responds to components of frequency 2u), in the 
spectrum of the function (rf), but investigation of higher-order 
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resonances requires the use of higher approximations. The present 
treatment is confined to a study of the fundamental purametric 
resonance and of the equations obtained in the first approximation 
(which coincide with the truncated equations of Chap. 4. Sec. 3). 


1. Linear Parametric Oscillations. The Basic Equations. 


Making the change of variable 


ft 


x(t) = exp {f s¢eyac} y(t), (10,3) 


0 
we transform the linear equation (10.1) into the form 
¥ + (k(t) — 52(1) —3(] x = 0. (10.4) 
From k(f)—6?(1)—4(t) we subtract out the constant component, 
denoting it by w%, and then denote the remaining expression by 
2x (4). 
woe (1): 
k(t) — 67(9) — 6(1) = oO [1 + E(9)]. (10.5) 
If k(r)—6°(1) is a stationary random process, we choose 
wg=<k(~5(n), 
so that € has zero mean value (€>=0. With the notation (10.5), equa- 
tion (10.4) becomes : 
¥ + wax = — woxe(t). (10.6) 
Using the same method as in Chap. 4, Sec. 3, we define the amplitude 
and the phase of the oscillations by the formulas 


x=A cod(wot +9), *=— woA sin (ot + 9). (10.7) 


As before, the amplitude and phase satisfy the equations (4.31), which 
in the present case, because of (10.6), take the form 
2 


A=-= 8), = 00 1280) (10.8) 
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or 
A 
Pe woe (f) sin (Wot + g) cos (wot +g), (10.9) 


@ = wot (t) cos” (aot + 9), 
after substituting from (10.7). 
The ainplitude A figuring in (10.9) is the amplitude of the “fictitious” 
process x(t), differing by the factor 


t 
exp {2 (ae 
0 
from the original process y(r) which has the usual direct physical 
meaning. The “physical’’ amplitude of the oscillations y(t) equals 
t 
exp |- fo (r') ar! A(t). (10.10) 
0 


After introducing the special notation 
u=In A~ | a(r)ae (10,11) 
0 


for the logarithm of (10.10), we can write (10.9) in the form 


n= —6()+ S E(1) sin (Qt + 29), 
> " (10.12) 
= "5 E(t) + “5 E(t) cos (2a! + 29). 


The equations (10.12) are perfectly exact and valid for arbitrary 
functions €(4) and 6(r)}, both random and nonrandom. Of course, we 
are interested in processes where €(#) and 6(1) are random, or at least 
contain random components. We shall assume that the smallness 
conditions 

E(‘)<«1, d(1) <a, (10,13) 


are satisfied, since otherwise it is difficult to solve the equations (10.12) 
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(although they remain meaningful) and the very concept of the 
amplitude and phase of the processes x(t) and 1:(r) loses 1s meaning. 

We now ask whether or not oscillations are excited in the system, 
i.e., whether or not the system is stable. It is easv to see that the answer 
to this question depends on the size of the mean value ¢%>, which can 
be determined from the first of the equations (10.12). Averaging this 
equation, we find that the inequality 


(8(t)) < 3 CE(t) sin (Quit + 2¢)) (10.14) 


represents the condition for excitation of parametric oscillations. In 
fact, if this inequality is not satisfied, then any oscillations present tn 
the system are completely damped out in the course of time, and hence 
the system is stable. Clearly, the quantity 


fe S CE (1) sin (Qeogt + 2¢)) (10.15) 


represents a ‘‘critical damping coefficient,” since the sy<tem is exctted 
if (d(1)> <6,, but not if ¢4(1)> >4,,, Le., the system can no longer be 
excited after (d(r)> reaches the value 6,,. 

Thus investigation of the stability of a parametric system reduces to 
calculating the quantity (10.15). This requires the use of the second of 
the equations (10.12), as well as the first, since the phase g(r) is 
intimately related to €(r). Fortunately, the equation for the phase does 
not contain «(r), and hence can be considered independently of the 
first equation. 

The trigonometric function cos (2u9f+2¢g) in the phase equation, 
which explicitly involves the time, singles out the harmonte coinponent 
of frequency near 2, from the function (1), a feature which is 
characteristic of the fundamental parametric resorlance. To study 
this effect in its pure form, suppose the spectral density of the process 
E(t) is appreciably different from zero only in a narrow band 


| —2u, | s hw 
near the frequency 2m, > 4w. Then €(f) can be written in tle form 


E(t) = A(t) sin [2wot + W(r)]. (10.16) 
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where the amplitude A(r) and phase ¥(1) are slowly varying compared 
to sin 2w of, but can vary rapidly compared to A(s) and ¢(*). Substi- 
tuting (10.16) into (10.12), using the formula 


2 sin (2mgf + ~) cos (2wot + 2¢) 
= sin (4wot + W + 2p) + sin (W — 29), 


and dropping oscillatory terms involving sin (4@gr+W+2q) and 
sin (2wof +) [which are unimportant in the first approximation], we 
obtain the following first-order “‘simplified”’ equation: 


pu = h(t) sin [2() — v()]. (10.17) 


In deriving this equation, which no longer involves the time explicitly, 
we commit the error of considering only the fundamental parametric 
resonance. We can transform the first of the equations (10.12), or the 
expression (10.15) for the critical damping, in the same way, ob- 
taining, for example, 


a ri (h(s) cos [29 (1) — ¥()])- (10.18) 


Unfortunately, even the simple equation (10.17) has no exact solution 
in quadratures. However, special results can be obtained by using 
conditions involving the rate of change of the functions A(r) and (7). 


2. Narrow-Band Quasi-Harmonic Parametric Oscillations. 


As can be seen from (10.17), the phase changes at a rate character- 

ized by the time constant 
1 

eS ee 10.19 

ery (10.19) 

which may be called the phase relaxation rime. In analyzing (10.17), 

it is important to know whether the functions A(r) and W(r) manage 

to change appreciably during the time T,,,. Consider the case where 

h(t) and (1) are slowly varying, i.e., where the time constants A/h, b/w 

and T, are all much greater than the phase relaxation time (T, denotes 
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the time for a change in w of order | to accumulate). Lettitig 7 denote 
the deviation 


x(t) = 29 (t) — ¥(4), 
we write (10.17) in the form 
Wa ; 
oes h(t) siny =— W(t). (10.20) 
If the frequency of the external excitation is slowly varving 


CZ b <a ht), the phase deviation y will differ only slightly from the 
“stable instantaneous” value y(t) determined from the equation 


w 
> A(t) sinys =—W, (10.21) 
obtained from (10.20) by setting g=0. Substituting the value 
2 
Yo = — arc sin ay (10.22) 
Walt 


[implied by (10.21)] into (10.18) instead of 29—y, we obtain the 
following expression for the critical damping: 


5, =4¢/wih?(t)— 40>. (10.23) 


For constant A and W, formula (10.23) coincides with the result of the 
ordinary nonfluctuational theory of parametric excitation. Thus exci- 
tation is possible only if |2y)|<w 9h, acondition which we shalt assume 
to be satisfied, since otherwise the quasi-static approach of this section 
would be inapplicable. 

A better approximation to 6,, can be obtained by taking account 
of the deviation 


M1 =7%— 720 (10.24) 


, 
from the value (10.22). For small deviations, equation (10.20) can be 
linearized, which gives the following linear equation: 


w) 
Mi + 5 h(t) cos yo(1)-x1 = — da- (10.25) 


Assuming that the process began in the remote past, we can solve 
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(10.25) by the usual method, obtaining 


S 


-hy dr 
paw fol renee 


-m 


w 5 
= za h(t) cos xo = ./fwoh? — p?. 


(10.26) 


Correspondingly, only the principal terms should be retained in the 
expression (10.18). Thus, dropping cubic and higher-order terms, we 
find that 


2 
6., = = (n COS Xo ( = *)) = > ch sin Xo" 1) 
| core Me, Se t l 


Substituting (10.26) and (10.22) into (10.27), we can calculate 4,,, 
given the statistical properties of the original processes A(r) and (#). 
These considerations are based on the use of the quasi-static method 
presented in Chap. 5, Sec. 3, and in fact, equation (10.17) clearly 
resembles the second of the equations (5.51). 

If the condition 


(10.27) 


l 
Y>- - 10.28 
; ew ( ) 
holds with overwhelming probability, then the quasi-static treatment 
of parametric excitation can be simplified. In this case, x is small 
enough to allow us to replace sin y by x in equation (10.20). This leads 


to the linear equation 
w 
it ed, (10.29) 


with solution 
r 


x(t) =— i aaa df’. (10.30) 


-@ 


We can now replace cos y by |—(y7/2) in calculating the damping 
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5,= (na (i-")). (10.31) 


where this expression can be evaluated by substituting fiom (10.30) 
and carrying out the average. 

For example, consider the special case where the aimplitude of the 
parametric oscillations is constant, but the phase undergoes a “‘com- 
pletely random walk,” so that w is a delta-correlated random process 
with zero mean and known intensity x: 


Cb.) = « 5(t). 
Then formula (10.30) becomes 


xy) =- en THOME ONG)’. 


—-—« 


(10.18), i-e., 


and hence 


P K 
X= (10.32) 
git 
because of the form of the correlation function of y. It follows from 
(10.31) that the critical damping is 


h 
aes i=). (10.33) 
4 2h 
Therefore the parametric system is stable if 
i 
eae Ge “). (10.34) 
4 2m ht 


and unstable otherwise. 

The first term w,/t/4 in formulas (10.33) and (10.34) can be ob- 
tained from the ordinary nonfluctuational theory. The second term, 
which is k/2u,/ times smaller than the first, describes the effect of the 
fluctuational instability of parametric oscillations on the excitation 
condition. Thus we see that instability of the parametric osciHations 
inhibits parametric excitation and is equivalent to decreasing the 
amplitude of the oscillations. Of course, the expression (10.33) is not 
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exact, and making it more exact would introduce a correction, whose 
relative size is in turn approximately «/2@,)/ times smaller than the 
second term. Formula (10.33) breaks down [or k/2m gh 2 |, since then the 
conditions for applicability of the quasi-static approach no longer hold. 

The above method is not applicable when the amplitude, phase and 
frequency change so rapidly that they manage to vary appreciably 
during a lime of the order of the phase relaxation time (10.19), since 
in this case it is difficult to solve (10.17) or (10.20). However, in the 
opposite extreme case, where the fluctuations are sulficiently rapid, 
one can apply the stochastic method based on replacing the actual 
fluctuations €(r) by a delta-correlated random process. 


3. Rapid Parametric Fluctuations. 
Application of the Stochastic Method 


We now assume that the phase relaxation time is much larger than 
the correlation time of the parametric fluctuations: 


Tet > Teor: (10.35) 


Here T,,; is given by formula (10.19), and t,,, is related to the rate of 
change of the functions W(r) and A(z), if we represent €(r) in the form 
(10.16). However, there is no longer any particular need to use this 
representation, and we can consider the equations (10.12) directly, 
regarding t,,, as the correlation time of the original process €(¢). 

It should be noted that the condition for applicability of the 
stochastic method is connected with the condition that the parametric 
fluctuations be small. In fact, if we decrease €(r), leaving its rate of 
change the same, the phase relaxation time increases until it eventually 
enters the region of applicability of the stochastic method, regardiess 
of the size of the correlation time. 

In the stochastic approach, we regard the process &(r) figuring in 
the equations (10.12) as a delta-correlated process. Then the phase 
fluctuations will be a Markov process, described by an appropriate 
Fokker-Planck equation, which can be written down by using the 
rules given in Chap. I.4, Sec, 8. Noting that the second of the equations 
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(10.12) is a special case of equations (1.4.142). und using formulas 
(1.4.161) and 4.162), we obtain the re Planck equation 


w(g)=— 5 g lim(o)w (+, [K.(y) «(¢)]. (10.36) 


where 


int 


a 
sat 
m,(9) = =: J CEE, yf oe + cos (2tagt + 2¢)] 
(10.37) 
x i + cos (2wW ot + Zot + 2) |edit. 
ow iv a] 
K,(y) = -- | CEE.> [1 + cos (2wgt + 2¢)] 
ie (10.38) 
x [1 + cos (2wot + 2twgt + 2p)] dt. 


The quantity (10.37) is the mean value of the right-lland side of the 
second of the equations ({0.12), i-e., of the expression 


=e E()[1 + cos (Qargt + 2¢)]. 


Since, by definition ¢€>=0, the fact that 1,(~) is nonzero is due to 
correlation between ¢(r) and g in the product &(1) cos (2wot +2¢).! 

Similarly, to study the stability of the parametric system. we need the 
mean value of the right-hand side of the first of the equations (10.12), 
and here an important role is played by correlation between &(r) and 
@ in the product €(r) sin (29f+2¢). The problem of averaging ex- 
pressions containing a random excitation and a Markov process was 
studied in Chap. 1.4, Sec. 8, where we derived formula (1.4.167). 
Using this formula, we find that 


CE(t) sin (2agr + 2¢)) 
0 
d 
= od | <éED Bp [sin (2eagt + 2¢)] (10.39) 


x [1 + cos(2mt + 2mgr + 2¢y)] dt, 
a result which closely resembles (10.37). 


1 The validity of (10.37), and of (10.39) as well, can also be estublished by using 
the approximation method described on pp. [10-113. 
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The expressions (10.37)-(10.39) explicitly involve the time, and 
besides constant components, they contain oscillatory components 
which vary rapidly with frequencies 2m, and 4w,. Since g and w(¢) 
change much more slowly, the effect of these oscillatory components 
is small. In a first approximation, they can simply be neglected, by 
averaging over a period, as in Chap. 4, Sec. 4. For example, ¢rans- 
forming the expression 


[1 + cos(2wot + 2¢)][1 + cos(2mot + 2wot + 2¢)] 
appearing in (10,38) into the form 


1 + cos(2wof + 2~) + Ccos(2wof + 2wot + 2¢) 
+ 4 cos2wor + 4 cos(4wof + 2wot + 4), 


and dropping oscillatory terms (the second, third and fifth terms), we 
obtain 


K,(9) = = | Cée,>[1 + § cos2wot]dt = - [k(0) + 4$x(2w)], 
ais (10.40} 


where 
K(w) = { CEE coswtdr. (10.41) 


In just the same way, after dropping oscillatory terms in (10.37) and 
(10.39), we tind that 


0 
2 
m,(9)=— 2 | CEE sin2wot dt, (10.42) 


=a 
0 


CE (1) sin(2wyf + 29)> = < | CEE) cos 2wWgt = oy K(2wy)- 
* (10.43) 


It follows from (10.43) that the critical dainping is 
2 


Sep = 2 CE(1) sin 2evot + 29)? =" x (2ar0). (10.44) 
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If d<6,,, then (> >0 in the first of the equations (10.12), and conse- 
quently parametric excitation takes place. 

Besides equation (10.36), corresponding to the second of the 
equations (10.12), we can also derive a stochastic equation associated 
with the first of the equations (10.12) and describing the evolution of 
the distribution w(u). Taking account of (10.44). we cau write this 
equation in the form 


Ow Ky, ew 
b(u) = (<d> — 4 — 4s 10. 
(u) = (€d> — 6.,) a + > eu? (10.45) 
where 
2 @ 
Wg : 
Kk, = K(2w.) + | K[6, 0, Jet (10.46) 


[cf. (10.38) and (10.40)]. The Fokker-Planck equations (10.45) and 
(10.36) are equivalent to the fluctuation equations 


w= 06.,,—(d> + €,, 


pees (10.47) 


containing the delta-correlated random processes 2, (f) and ¢,(1), with 
zero mean values and intensities (10.46) and (10.40). respectively. ie., 


CEE: = Kr O(t), (Sabo) = Kp 8(0). 


As an example, we now consider the same case ats at the end of the 
preceding section. Let &(r) be an oscillatory process whose amplitude 
his fixed and whose phase y undergoes‘a “completely random walk”: 


E(t} =A sin[2e@gf + W (4). 
(> =0, CW) =«5(t). 


To apply the stochastic method, we must require that the phase 
deviations be sufficiently strong and hence that « be large. Thus, during 
a time of order t/wgh, the phase must “change completely,” ie. a 
phase shift much greater than z must accumulate. Because of the form 
of the correlation function of J, this condition becomes 


(10.48) 


‘3 
>i. (10.49) 


ooh 
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The correlation function ¢€&,> is easily calculated from a know- 
ledge of the characteristic function of the phase increment after time t: 


O(v) = (exp {i fv an) =e"? (r>0). (10. 0) 


If we average over the random initial phase, an oscillatory term de- 
pending on ¢ drops out of ¢&&_>, leaving 


h? 
CEE.) = > Ccos(2m97 + He — ¥)>. (10.51) 
But cos (2m97+W,—W) is the real part of exp {i (2H9t+¥,—W)}, and 
hence (10.51) is easily calculated by multiplying (10.50) by e7'°**, 
taking the real part and setting v=1. This gives the correlation function 


he teHy2 
(Cl = 5 ¢ "IH? cos 2ugt, 


with corresponding spectral density 


hk l 1 
: OP pains = : 5 f. 10.52 
#(a) 4 a + (w — 2,4)” (4k)? + (m+ sa | ( 
Substituting (10.52) into (10.44), we find the critical damping 


je ie 10.53 

coc 8 K2 + 642 7 ( . ) 

It is interesting to compare this result with the critical damping 
coefficient (10.33) for the case of weak phase diffusion. According to 


(10.33) and (10.53), we have the following dependence of 6,, on 
xX =K/gft (restricting ourselves to values K <8u)q): 


x 
46., rs for x <€l, 
—= (10.54) 
Walt 1 
— for x>l. 
2x 
This asymptotic behavior for small and large x is shown in Figure 34, 
A theoretical analysis for intermediate values is difficult, but it is 
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perfectly clear that the true unknown curve must smoothly join the 
two curves corresponding to the limiting cases, as indicated by the 
dashed curve in the figure. 


Fig. 34. Dependence of the critical danyping on the intensity of the phase diffusion. 


The example just considered allows us to study the transition from 
purely harmonic parametric oscillations to the case of strong fluctu- 
ational scatter. Under this transition, the spectral density ol the oscil- 
lations, initially shaped like a delta-function, gets progressively 
broader, first reaching a bandwidth of order w,</> and then a much 
larger bandwidth. The increasing instability mukes it progressively 
more difficult to excite parametric oscillations, i.e., since 5,, decreases 
monotonically, the values of (5) leading to parametric excitation must 
be smaller and smaller. 


4. Simultaneous Harmonic and Fluctuational Excitations 


Next we consider the ¢ase where the parameter changes contain both 

a purely harmonic component and a relatively broad-band fluctu- 

ational component, Then the spectral density of the process ¢(1) has 

a twofold structure, i.e., it contains a discrete line immersed in a 

continuous background. Denoting the fluctuational component by 
€(1), we have 

E() =k sinve+ C(2). (10.55) 
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The correlation function (&&,> is easily calculated from a know- 
ledge of the characteristic function of the phase increment after time t: 


tte 


O(v) = (exp {w | var) =e"? (¢>0). (10. 0) 


If we average over the random initial phase, an oscillatory term de- 
pending on ¢ drops out of (¢€,>, leaving 


hh? 
(EY =F (e0s(2u9t + He — W)>. (10.51) 


But cos (2w,t + ¥,—W) is the real part of exp {f(2w,t+W,—)}, and 
hence (10.51) is easily calculated by multiplying (10,50) by e7/°*, 
taking the real part and setting v= 1. This gives the correlation function 


h? 
(lp = > e “Il? cos 2ugt, 


with corresponding spectral density 
h?x 1 1 
0) SN a et ae . (10.52 
0 Terentia orto} 10 
Substituting (10.52) into (10.44), we find the critical damping 


wah K? 
6., = “4” 1+ F (10.53) 


It is interesting to compare this result with the critical damping 
coefficient (10.33) for the case of weak phase diffusion. According to 
(10.33) and (10.53), we have the following dependence of 6,, on 
x= k/wgh (restricting ourselves to values x <8): 


x 
1 — 3 for xX <€ 1 . 
= (10.54) 


1 
x for x >. 


46., 


Wh 


This asymptotic behavior for small and large x is shown in Figure 34. 
A theoretical analysis for intermediate values is difficult but it is 
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perfectly clear that the true unknown curve must smoothly join the 
two curves corresponding (to the limiting cases, as indicated by the 
dashed curve in the figure. 


Fig. 34. Dependence of the critical damping on the intensity of the phase diffusion. 


The example just considered allows us to study the transition from 
purely harmonic parametric oscillations to the case of strong fluctu- 
ational scatter. Under this transition, the spectral density of the oscil- 
lations, initially shaped like a delta-function, gets progressively 
broader, first reaching a bandwidth of order m)</> and then a much 
larger bandwidth. The increasing instability makes il progressively 
mote difficult to excite parametric oscillations, j.e., since 6,, decreases 
monotonically, the values of (56> leading to parametric excitation must 
be smaller and smaller. 


4. Simultaneous Harmonic and Fluctuational Excitations 


Next we consider the case where the parameter changes contain both 

a purely harmonic component and a relatively broad-band fluctu- 

ational component, Then the spectral density of the process ¢(r) has 

a twofold structure, i.e., it contains a discrete line immersed in a 

continuous background. Denoting the fluctualional component by 
&(t), we have 

&(t) =A sin vt + C(z). (10.55) 
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Since we are interested in the fundamental parametric resonance, 
which is described by the first approximation in the standard equations, 
we shall assume that the frequency y of the harmonic component is 
near 2m. Thus, introducing the “‘mismatch” 


A=2u, -—1, (10.56) 
we impose the condition 
A a gil < Wy . (10.57) 


In (10.55) we omit the arbitrary initial phase of the oscillations, which 
depends on the choice of the time origin. 

The derivation of the standard equations is almost the same as in 
Sec. 1, except that we now define the phase somewhat differently by 
writing 


¥ y y 
=Acos{-f , x= in{—f 10.58 
x G +9] x 5 Asin (3 +9] (10.58) 


instead of (10.7). This leads to the equations 


2 
y 


1 
t@=—d(t)+- (03 res ui sin(vi + 29), 
y 
- (10.59) 
ree er 2 
g=- (i me + ui [1 + cos(wr + 2¢)] 
v 


instead of (10.12). Substituting from (10.55) and dropping oscillatory 
terms, we find that 


Walt 
w= — d(f+ ra cos 29 + =" €(1) sin(vt + 2g), 
7 (10.60) 


OF: 


7 Wg 
ar 29 + Sy C (4) [1 + cos(vt + 2¢)]. 


Here we have simplified the coefficients by using the inequality 4 <wo, 
which justifies the approximations 
ge Sy MG % 
I a al Far a 
We shall assume that the fluctuations €(r) are comparatively broad- 


band, i.e., that their correlation time is small compared to the phase 
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reJaxation (ime 
i 
Toop K —,- (10.61) 
Molt 

Then we can apply the stochastic approach to the equalions (10.40), 
just as in Sec. 3. The fluctuational terms in (10.60) are exactly (he same 
as in (10.12), if (1) is replaced by C(t). Suppose we separate each of 
these terms into two parts, an average value and a fuctuational 
increment: 


> C(t) sin(vt + 29) =m, + &, (1), 
7 (10.62) 
= C(A)[1 + cos(vt + 2@)] = mz + Co (1). 


Then, if we write (,=¢,()~[6()— (1) ], the equations (10.60) 
take the form 


Wolk 
w= mM, —~(6() +— cos2p9 +); 
4 
(10.63) 
. ya | re Walt in? +e 
=-- +I, — — Si ; 
5) 2 4 9p 2 


where the mean values mt\,?"2 and the intensity coefficients K,, Kz 
are defined as in Sec. 3, after replacing & (1) by €(1), for example in (10.37) 
~(10.44) and (10.46). The most important formulas are 

2 Lun} 
Wo 2 2 
K, = “. K (2a) + | [<d6,> — ¢d>°]adz, 


2 
K, = [k(0) + $x 2ev)], oa 


2 
m, = 3 CC(1) sin(vs + 29)> = : K (209). 


where x(q) is now the spectral density of the random process (1). 
In (he case where the damping is nonrandom and constunt in (ime 

and ¢(r) contains no low-frequency components, the integral in (10.64) 

disappears and x(0)=0, so that ¢} =¢, and both processes ¢; and ¢, 
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have the same intensily coefficient 


2 
Kai ake = x (204). (10.65) 


For simplicity, we shall assume that this is the caseand also that m, =0, 
although removing these restrictions does not cause any trouble (for 
example, a nonzero value of 77, can always be included in the term 
A/2). Averaging the first of the equations (10.63), we obtain the critical 
damping 


h 
O., = My + = {cos 2). (10.66) 


Thus, to find 6., we must calculate (cos 2@>, using the second of the 
equations (10.63). 

If the condition (10.61) holds, we can regard the processes ¢, and ¢, 
in (10.63) as della-correlated, with correlation function K 6(t). Then 
the phaSe equation gives rise (o the Fokker-Planck equation 


O[f4 woh . K aw 
W(g) =— se IE ~ me sin 20) “(o)| Ss ag?’ (10.67) 


which, except for notation, is the same as equation (9.44), encountered 
in the theory of synchronization. The stationary solution of this 
equation was found in Chap. 9. Using the periodicity condition and 
applying the method which led to the expression (9.52), we obtain the 
stationary solution of (10.67): 


1 1 } 
w(g) = re exp ti (40 + = cos 20) 
etn (10.68) 


| Wohi 
x { exp \- ‘ (40 + a cos2y)h dw . 
@ 


This stationary probability density is periodic with period x. The 
constant N is determined from the normalization condition 

2n 

[ »@do = Ly (10.69) 


9) 
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which gives 


8 otnr 
N 2[ 4 : 1 y y (oh ) (olt 2u bd 
= P| XP 57 4e- Wie mae mer ees 7 aoe 
0 ? 


or 


ee A j 
N= 2| | exp - 2 X+ rd sin ¥ sin(2g + ah dpdy, (10.70) 
0 9 


after introducing the variable y= gy —w. Expressing the integral with 
respect to y in terms of a Bessel function and then making the change 
of variable 


pany for O<y<5, 


me 2 
- x for = P< 

X75 c 4k , 

we obtain 
N=2 i ~ariky, (200 sin y\ dy = In? en" i coolt\ 10.71) 
= —s5 = 2n- al — : 
aye Ol oK ny }ay=2r e [a 4K J ( 

0 


where q = 4/2K, which is the analogue of (9.53). 
To calculate the stationary mean value (cos 2p), we must now 
average with the weight (10.68). Writing 


cos 2 = cos(2y + 4 — x) = cosx cos(2p + x) + siny sin(2p + y), 


and replacing y by » +x in (10.68), we have 


(cos 20> = 2 [cos 29 w(y)dg 
0 
2 ; : 
aa [ { tcosx cos(29 + x) + siny sin(2p + x)] 
00 


4 Woh 
xexp<— — -—- siny sin(2g + lp dy. (10.72 
exp | Pa eer sin x sin(2 1} dp ) 
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Because of the way cos (29+ x) and sin(2g+y) change sign, it is 
easily verified that 


x j 
| cos9 + x) exp ee sin x sin(2g + 2} dp=0 
0 


for any value of x. Therefore only the second term in (10.72) has to be 
taken into account: 


(cos2@) = . {| sin x sin(2g + x) 


00 


(10.73) 
x exp ¢— is x+ oe sin x sin(2p + a do dy. 

K 2K 
But the integral (10.73) can be obtained from (10,70) by differentiating 


with respect to wo/t/2K, and hence the desired mean value can be 
simply expressed in terms of the function (10.71), i.e., 


jugs 1 dN F(Ge A (10.74) 
OS = -- —-—-~=Fi{—-, -—], ; 
soit N | (ooh 4K’ 2K 

2K 


td 1d 
F(z,q)= re InN(z) = a as In[d;g(z)7~ig(2)]. (10.75) 


where 


Using elementary properties of the function /,(z),? we can also write 
(10.75) in the form 


Peril) | A-ia() 
Fea=3| ity Fal oe 


Substituting (10.74) into (10.66) and dividing both sides of the 


2 We have tn mind the recurrence relations 
TIp-1(z) + Ip+i(z) = 2Jy’(2), 


2 
Ip-a(2) — Ipn(2) = “= Jol). 
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resulting formula by 


2 
w 
K= 7 K (2a), 


we can express the critical damping in the form 


é. ' Woh : wo A 

K 4K Gz sé): oe 
Using (10.75) or (10.76), we can now obtain numerical results by 
using tables of Bessel Functions of imaginary argument and iniaginary 
order. Moreover, in Various special cases we can deduce inforination 
by using different asymptotic expressions for the cylinder functions. 
In this regard, the important thing is the relation between the argu- 
ments w h/4K, 4/2K and unity. Depending on the size of w,h/4K, we 
have three cases, ie., relatrvely large amplitudes of the harmonic 
excitation (woh/4K >1), intermediate amplitudes (cf/4K~1!) and 
relatively strong noise (woh/4K <1). But at the saine time we can 
independently use the size of 4/2K to distinguish the cases of small 
mismatch (4/2K <1), intermediate mismatch (4/2K~1) and large 
mismatch (4/2K> 1). In Table 3 we classify all these different cases, 
which lead to 11 distinct regions (the ninth region can he fitrther 
subdivided into 3 subregions). 


TABLE 3 
| [ 4 {4 fs 
reghices! oe oe > 

| | 3K<' | 3K 2A 
| ooh " 24 ey : 3 24 Poe. on EA 3 

—— > — — =— -.™ > 
| 4K ont cook walt tuft eft 
| Walt . 24 Ms 24 4. 24 

—~] ~— €]1 —-~ I sx | 
| 4K Walt cagh 1p! 

| _ ren : 

tooh 9. 10, I 2-4 

— < —->l - > | 

4K coh } Coyh 
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We now discuss the various special caSes, beginning with large 
amplitudes wol/4K>1 (regions 1-5). In regions 1-2 we can use the 
asymptotic representation of the Bessel function 


1 
Jaig(iz) & == e7* #9, (10.78) 
J 2nz 
For large g>1 (in regions 3-5, 8, 11) we can use formula (9.57). 
Moreover, in region 3 and part of region 4, we can replace the functions 
Hey), HEYiy), where 
1 2 2\3/2 
= —5 (2° — : 
y 3q° q) 

by asymptotic expressions valuable for large y>1. This leads to the 
formula 


1 a 
a ei? Arctan vy (» = av? = 7) ; (10.79) 


J iq(iz) & 


which clearly includes (10.78) as a special case, since whether we 
choose Arc tan v equal to arc tan v or —x+arc tan v depends on the 
sign of the index + ig. Substituting (10.79) into (10.75) and differ- 
entiating, We obtain 


ne 
F (2,4) - /2 qd Aaa ae (10.80) 


Therefore the critical damping (10.77) is given by the approximate 
formula 


sr ji (+ ce ee 
K aK Vv \woh) a 7 ae 
~ Woh 


valid in regions 1-3 and part of region 4. 
The main term in (10.81), which by itself gives 


5. =4/azh? — 447, 
is not of a Auctuational character, and can be obtained by using a 


simple theory ignoring fluctuations. On the other hand, the presence 
of the last two terms is associated with the random excitation. These 
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terms deScribe the displacement of the boundary of the region of 
parametric excitation as a reswt of fluctuational “impacts.” 

It is apparent from (10.81) that parametric excitation becomes pro- 
gressively more difficult as the mismatch (more exactly. the relative 
mismatch 24 /a9/t) is increased. The presence of the fluctuations at first 
enhances excitation, for (24/wh)?<4, and then, for (24/e,h)? >4, 
inhibits the excitation caused by harmonic parametric oscillations, 

In region 4, the case of values of 24/woh close ta unity occupies a 
special position, Then formula (10.81) ceases to be valid, and more- 
over, it is just for such values that the contribution of the nonfluctu- 
ational first term in (10.81) becomes comparable to the contribution 
of the other terms. In other words, the role of the harmonic parametric 
changes in the excitation process decreases to the point where it is 
comparable to the role of the random parametric fluctuations. For an 
even larger mismatch 

ice 
the harmonic oscillations become less important than the random 
fluctuations. We shall not analyze the transition region 


24 

—-lé€l 

Moh 
in detail, since it contributes only a small part of the whole range 
24/mgh~1 comprised in region 4. Such an analysts can be made by 
using formula (9.57) to obtain an expression for 6,,/K involving \artous 
cylinder functions of order 1/3 and their derivatives, in fact the loga- 
rithmic derivatives of the very combinations of cylinder functions 
appearing in (9.60) and (9.63). 

For values 


ie., in the rest of region 4 and in regions 5, 8 and LI, the cylinder 
functions of order 1/3 have arguments greatly exceeding nity and can 
therefore be replaced by their asymptotic expressions, As a result, we 
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obtain 
u 2 qu? 2 | 2S 
Jiq(iz) J_iq(iz) ( =) ip ( “) ES (qu = /q? - z*), 
A2Y3 3 /|  2nqu 
and hence (10.82) 
PSS eae 
Oc, 1 


Be eee ie ee (10,83) 


in regions 5, 8, 1] and part of region 4. 

The only difference between (10.83) and (10.81) is that the first term 
of (10.81) is absent. In the intermediate region (24/woh)—1 <I, the 
cylinder functions smoothly (‘analytically’) cause this term to dis- 
appear. The number | appearing in the right-hand side of (10.83) has 
a simple meaning, i.e., it is the value of the ratio 6,,/K in the absence 
of harmonic parametric oscillations. The effect of these oscillations is 
described by the second term 

1 1 


2 ( 24 ) 
-—-} —1 
Welt 


Thus the harmonic oscillations increase the extent to which the 
fluctuations are effective in producing excitation. However, even this 
stimulating effect drops to zero as the amplitude / is decreased (or 
the mismatch 4 increased), and hence it can be neglected in regions 
5, 8 and II. 

The dominant role played by the harmonic parametric oscillations 
in region | disappears if we increase the mismatch or noise level, or 
decrease the amplitude #, i.e., as region | turns into region 6 or 9, 
We now examine this phenomenon in more detail, for the case of zero 
mismatch, which corresponds to the most favorable condition for 
excitation of parametric oscillations. Setting 4=0, g=0 in (10.75) or 
(10.76), we find that 
I,(z) 
Io(z) 


F (z,0) = (10.84) 
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so that formula (10.77) becomes 


Wohi 
I; TES, 
é., wot '\ 4K ) 


Ko aR 1 (2) 
Ig nee aa? 
4K 
in regions |, 6 and 9. In region |, the second term predominates, In 
this case, the asymptotic formulas imply 


Iy(z) _ 1 a 
ta =1-3-+0(S). 


This allows us to separate (10.85) into a basic nonfluctuational term 
and a main noise correction, whose effect is comparatively small: 


(10.85) 


Scr | 
r = + 5 (in region I). (10.86) 


As the amplitude of the harmonic oscillations is decreased (or the 
noise level increased), the second term in the right-hand side of (10.85) 
decreases and becomes comparable to the first purely fluctuational 
term. As the amplitude is decreased further, it begins to play a subor- 
dinate role, and in region 9 the basic correction due to the harmonic 
oscillations can be written in the simpler form 


é 1 farh\? 
Ts ae es ie 10.87 
K 145 (42) ad 


The dependence of the critical damping (10.85) on the ratio «9f7/4K 
is shown in Figure 35. Both kinds of parametric oscillations, harmonic 
and fluctuational, lead to parametric excitation, 

In regions 9 and 10, as in regions 5, 8 and 11, the role of harmonic 
Parametric oscillations is very small. 1n fact, the function F=<cos 29) 
cannot exceed unity, while the factor woh/4K is small and makes the 
second term in (10.77) much smaller than the purely Nuctuational lirst 
term. It should be noted that the elementary theory given in Sec. 3 1s 
sufficient in regions 5, 8 and I!. Region 7 is the most diflicult to 
analyze, since simple asymptotic expressions are no longer applicable, 
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Fig. 35. The critical damping for zero mismatch. 


Here we must make direct use of formula (10.75), expressing F(z, 4) 
in terms of Bessel functions of imaginary argument and imaginary 
order. 


5. The Amplitude Distribution. Effect of Nonlinearity 


So far we have been interested in the condition (6) <6, governing 
paranmtetric excitation, However, the above theory can be made to 
yleld further information, concerning oscillations of amplitude in a 
parametric system, 

Thus we return to the equations (10.12). If We are interested in the 
behavior of the system during time intervals 4/ much Jarger than the 
correlation time of the random function €(f) sin (2w9r +2¢) [and also 
of the function 6(r), whenever 6(f) is random], the first equation takes 
the form 

t= 5, — (6) + Ex(1) (10.88) 


[cf. (10.47)], containing the delta-correlated process of intensity 
(10.46). Equation (10.88) corresponds to the Fokker-Planck equation 
(10.45). If the quantity wu is fixed at time ‘=O, i.e., u(0)= ug, then the 
probability density w(u,f) at any other instant of time is obtained 
by solving (10.45). As is easily verified, the solution of (10.45) 
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is given by 


l l ; 
w(u,t) = Jink,t exp {- 3K ut [u ~Ug- (5., = Cory : 
I 


(10.89) 


By making the simple change of variable v=In A, we go [rom the 
logarithm of the (physical) amplitude of the oscillations to the ainplitude 
itself. This gives the following law for the evolution in time of the 
amplitude distribution of a linear parametric system: 


{ 


(A ft) 1 Ao} I l (2 =) 
W(A,f) = —=* exp<—~--- IN ~—€ 
J2nKyt Kt \4, / (10.90) 
(y = 0., ~ (9), An =e"). 


Given any amplitude level 5, it is not hard to see that as ‘> 0) the 
probability of the inequality A(1)>6 approaches | if 5.,.—<5>> Oand 
0 if 6,,-¢6> <0, Therefore a stationary regime of parametric osejl- 
lations is impossible in a purely linear system, since the oscillations 
would either increase without limit or fall off to zero. Of course, in 
any practical system the amplitude cannot become arbitrarily large, 
since the system would be destroyed unless some nonlinearity liniting 
the amplitude came into play. Thus we must introduce nonlinearity 
before the stationary amplitude distribution can be calculated. 

As an example of a nonlinear parametric system, consider the sclf- 
excited system described by the equatign 


f+2Po t+ay7]y+oi[(1 +E] y=0 (2>0), (10.91) 


where, compared to (10.1), there is a nonlinear term, the dumping 6 
is taken to be constant, and k(r) is chosen in the form wa[1 +é(r)], 
instead of (10.5). This time we do not make the transformation (10.3), 
so that x=y and Ae" is the physical amplitude, rather than the 
amplitude of the fictitious process (10.3). Going over to the variables 
u and g defined by the equations 


y=e"cos(Wot +9), Yr Woe" sin(wof + ¢), (10.92) 
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we obtain the fluctuation equations 
u=6d,,-d-ae™" + Ex (1), 
g=m,+€,(1), 
by the usual method [cf. (10.47) ]. Assuming that the process &(r) has 
a sufficiently small correlation time satisfying the conditions 
x 1 
T or < commen | 
1S, as d| 
we can regard the random processes €,,¢, as delta-correlated, i.e., 
Coie = K,6(t), (Esta = K,6 (t), 
where the quantities 6,,, 712, K, and K, are given by the previous 
formulas (10.40), (10.42), (10.44) and (10.46).° 
The Fokker-Planck equation corresponding to the first of the 
equations (10.93) ts 


(10.93) 


Teor < Tet ’ 


é K, 6° w(n) 
W(n) =~ > [bq 8 ~ ae") w(u)] + a a (10.94) 
with stationary solution 
f 2 . | “ 
w(u) = C exp 4 -— (6, —d)u — — e*"}. 10.95) 
(4) 1K, ‘ ) K, ( 


Returning to the amplitude A=e” and determining the normalization 
constant C, we obtain the stationary amplitude distribution 


2 ewe 1 ~2(8/K.), -aA2/K 
w(A) = a ae (<.) A ( Ye eae (10.96) 
r (: ~ z) 
Ky 


(after using the formula 6,,=K,). Except for notation, this is the same 
as the probability density (7.43), plotted in Figure 20, p. 183. In the case 
where 6 <K,, (10.96) is close to being a Rayleigh distribution. 

The expression (10,96) is meaningful only if the condition K,>6 for 
parametric excitation is satisfied. In the opposite case, (10.96) has a 


3 Note that now 
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nonintegrable singularity at zero (A =0), which corresponds to taking 
w(A) to be a delta function 6(A). In reality, of course, Huctiutions of 
a nonparametric nature prevent the amplitude from vanishing cxaclly, 
even when the parametric system is stable, In fact, these Nuctuatians 
appear as an additive term in (10.91), producing a certain minimum 
amount of amplitude scatter even under stable conditions. As a result 
of these two effects, the limiting of the amplitude by nonlinearity in 
the system in the case of parametric instability and the presence of a 
minimum amount of amplitude scatter under stable conditions, there 
is no qualitative change in behavior in going from stable to unslable 
conditions (as would occur jn an ideal linear system). This transition 
is accompanied by a certain broadening of the amplitude distribution, 
a broadening which is more noticeable the smaller the additive 
fluctuations. If the nonlinearity and the level of additive Muctuations 
are both large, the broadening of the probability density 1:(A) due to 
loss of stability can hardly be distinguished from the broadening due 
to increasing K, within the region of applicability of formula (10.96). 


6. Parametric Systems with Two Branches. 
Parametric Amplifiers 


Another phenomenon of interest in radio engineering (besides 
parametric excitation) is that of parametric amplification, which occurs 
when an external excitation, described by an additive terin in the 
equation for the oscillations, is applied to a parametric system i the 
stable state. Then the “pumping action” of the energy of the purame- 
tric oscillations, although not large enough to cause excitation, “‘accu- 
mulates”’ and is transferred to the signal, causing it to be aimplified. 

In the case of harmonic excitation, the equation describing the 
parametric system takes the form4 

¥ + 26% + w2[1 +h sin(vt + W)] x =— GE sin(w,t + y). 
(10.97) 
4 Here again we do not make the transformation (10.3), so hal.x = 1 and 4 is 


the phystcal amplitude, For the time being, we ignore random fluctuations in the 
parametric oscillations A sin (ve + yh). 
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Suppose the external frequency w, is close to the natural frequency wo 
and v is close to 2w . Then, in the usual way, the transformation (10.7) 
leads to the following truncated equations: 


} 
A=- 544 A cos[(2w» - v)r +29 — W] 
E 
+ cos[(@) ~a,)r+o— x], 
g= — oe sin[(2u.) — v)f + 29 — w] 


M,E 
- -s sin[(@) — a,)t + op - x]. 


If both “mismatches” vanish, i.e., if w>-w,=0, 209—-v=0, these 
equations become 


} E 
A=~dA +—~ A cos(2o — ¥) + —"- c0s(9 ~ ¥), 
4 2 
- a (10.98) 
g=—-7 sin(2p — Y)— =F sin(g — W). 


It can easily be seen from (10.98) that the amplification depends in 
an essential way on the phase relation between the parametric oscil- 
lations A sin(vf+w) and the external oscillations E sin(,f+ x). In 
fact, according to the second of the equations (10.98), for the ““favor- 
able” phase relation f = 2y,a constant phase p= x= w/2 is established, 
and the first equation takes the form 


Woht MoE 
=—-({d~- —]A+—_, 
A ( =| +, 


corresponding to an amplification factor of 
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However, for an “unfavorable” phase relation, ¢.g., #=2y+72, para- 
metric oscillations not only do not guarantee amplification, bit, on 
(he contrary, lead to extra damping in the circuit. with couconmitant 
signal attenuation. Thus, if E>, we have py, and hence 


ci ee ea 
e §~ 2 cos (2y~y) 
which becomes 

A @ [ 

EO 2 5 woh 


if 2y-—W=+2x. Although this dependence of antptification on phase 
is sometimes useful in special applications, it is in general unsustable 
for the purposes of undistorted signal amplification. und can be 
avoided by the use of parametric systems with two branclies, to which 
we now turn Our attention. 


Fig. 36. A parametric system with two branches. 


Figure 36 shows a parametric system with two branches, coupled 
by a variable capacitance C(r). External e.mf.’s (or e.m.f.’s due to 
thermal nojse in the resistances R, and R,) are applied to each branch, 
and are denoted by £,(t) and £,(r). Using the currents J,. /, and | 
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shown in the figure, we write down Kirchhoff’s equations 
i 
Cy 
1 
Ll, +R =- C, (+ Ddr+ Ey, 
2 


1 1 1 


In terms of the notation 


1 1 
mae | hdr, n= Z | hat 


the last equation gives 


a 
— +—+—]|| ldr=x, — x2. 
Ea c =|f oe 


Therefore the first two equations become 


; 2 2 Cy" 2 
X, +26,X, + WX, =} C4 C4! TO Pe! (xX, ~X2) + w{E,, 
1 2 
Xy +25,%, +03 2 Gi" —— )+m3E 
oe X5>=O5 —;— Xa—~X am 
2 +204X, + @3X2 2c e Gt +cn 1 262; 
where 
i R 
2 x 
O + -— > 20, = ~ k=1,2 : 
EG. sae ( ) 


These equations can also be written in the form 
es os 2 2 
Ky + WpX, = with; ¥. + 3X, = O7f,, 


by introducing the notation 


26, . 
fi=- oD? + 7H (t)(x; — x2) + Ey, 
1 


26 1 
in=> 5 ky + - HN (x, -x,) +E, (10.99) 
w ' a 
H(t)=— co JOC ae | 2 
CC. +(C, + C,) C(t)’ Cy 
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It can be assuined that the d-c component of the variable capacitance 
C(1) is small and hence has a negligible effect on the naturil [requencies 
w, and wu) of the branches, Otherwise, instead of v, and x, theinselvyes, 
we could consider linear combinations of x, and x, (corresponding to 
the “normal moades’’), thereby obtaining a circuit equivalent to that 
shown in Figure 35, but with a small coupling capacitance. On the 
other hand, we assume that the a-c components of (1), 6,, 53, E, and 
E, are small. Then the processes x, and x, are narrow-band, and they 
can be investigated by using the methods described above. 

With these assumptions the complex amplitudes 


x : x 
Z1 =(s4 a) ae za=(s2+ : oe (10.100) 
iw, ia, 


[cf. (I.7.31)] vary only slightly during the periods 22/«, and 2z/w,. 
According to ([.7.32), the time variation of the amplitudes (10.100) is 
described by the equations 
2; = e "'(X, + aix,)=—ia, eS, , (19.101) 
2,=—in,e '°"f,, 
where the arguments of the functions f, and /, are given by 
x, =4 (z,el" 4 zhe OH), 


iw, 


4 10 
Sang (eel ate) (k= 1.2) (10 102) 


[ ef. (1.7.34) ]. Substituting (10.102) into (10.99), we note tliat the terms 
of the form zfe 7!" have only a slight effect and can be dropped. 
In fact, during half a period, zy remains virtually unchanged during 


half a period, and hence the effects of the term zye~7"' cancel each 
other out. As a result, we obtain 

iw : 
2, +642, =— > (Hz, + He 2 2t — Helter, 


a} tas . 5 _t 
— He iC, mal 2°) im Eye hl Ue 
= is 3} * : _ 
2,+ 022, =— By (Hz, + He 7% 25 — Heller nz 


= fe MO tes) —ia ke, 


(0.103) 


310 NONLINEAR SELF-EXCITED OSCILLATIONS (cH. 0 


It is clear from (10.103) (hat the complex amplitude z, (say) is ap- 
preciably affected by the spectral components of (he function H(r) 
near the frequencies 0, 2w,, |w, —@2|, @; +2, and also by (he com- 
ponents of E,(r) near the frequency w,. The first frequency band is 
due to instability of the natural frequency of the branch due to slow 
parametric fluctuations, while the second frequency band w~2w, 
corresponds to the fundamental parametric resonance. Both of these 
phenomena are covered by the ordinary theory of parametric 
oscillations in a single-branch system, and hence will not be con- 
sidered here. Instead we restrict ourselves to an investigation of 
the band @+w,+,, due entirely to inleraction between the (wo 
branches. 

6.1. Suppose H(t) and E, (1) are close (o being harmonic oscillations 
of frequencies w, and w,, respectively, I.e., 


H(A) = ho (d) sin[(@, + o2)1+ ¥(O], 
E,() = Eo (0 sin[wyt+x(O], £2()=0,. (10.104) 


where fig(f), Eo(), w(r) and y(n) are slowly varying amplitudes and 
phases. Writing sines in the form 


sin ® = : (ef — e'*), 
2i 


and substituting (10.104) into (10,103), we find that most of the terms 
on the right are rapidly varying and can be dropped. In fact, the only 
terms (hat remain are 

o 


5 E() 


Zz + O12, = “e h(t)z> + 
(10.105) 


w 
Z, +6222 = a h()z}, 
4y 
where 


A (1) = hg (t) Pu E(t) =E, (1) eit) 


are the complex signal amplitudes. 
In the special case where the signals H(t) and E,(f) are strictly 
harmonic with frequencies v and w,, the equations (10,105) take the 
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form 
2,+6,2,= ou he'*' 23 OR ly 
26 (10.106) 
Fe ee _ 2 ht aad re 
4y 


where h=h, e'¥°, E= Ey e'®* and 4,, 4 denote the mismatches 
4, =0,—-—M%, A4=V-—W,-a). 
Then the change of variables 
’ —-Ar ’ —Ajt 


2, -€e 21, 22=e "2, (4,=4-A)) 


transforms (10.106) into the equations 


w 
2, +012) as hz} = — E, 
(10.107) 
a + afzit -- = h*z; =0 


with constant coefficients, where 
&, =a,(4,)=6,4+14,, a, =a@,(4,)=6,+i4,. (10.108) 


Looking for a Solution of the system (10.107) in the form const e”, 
we obtain the characteristic equation 


w 
po t+(a,+ a3) p Bs 01,005 i 


determining p, with solution 


2,@ 
NON sear 
For hg=0, we havep, = — «,,p) = — «3. As hy increases, the damp- 


ing in the system decreases, with the absolute value of the real part 
of one of the roots p,, p, becoming less that 6,, 6;. For sulliciently 
large hg=h,,, this real part vanishes, and for still larger values li) > fr,,, 
it becomes positive, testifying to unlimited growth of [he oscillations, 
i.e., selfexcited oscillations. From the condition Re p=9. we find the 
critical value of the amplitude of the “driving force,” corresponding 
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3,5, jus 
ona [ee (54 ae a). (10.109) 


Parametric amplification can only occur in the stable regime, when 
Re p, <0, Re p,<0 and all the transients are damped out with time 
constants 


to loss of stability: 


1 


T.2 St 
— Re p12 


In the case where the frequency of the driving force is tuned to equal 
the sum of the natural frequencies v=m,-+2, we have 4=0, and 
hence 

2 


51 +52 ¥ S(6, — 52) + Jay, h3 


When an amount of time {> T,_, has elapsed from the initial time, 
all the transients die out and a stable regime is established, corre- 
sponding to zero derivatives z,, 25° in the equations (10.107), which 
can then be solved for the stationary complex amplitudes of the forced 
oscillations: 


Ti .2 = 


! —idu = ad | ef 
: 2 aa — qww.hG 
oes -tan_ | Oh 
Zy2=22¢@ =— EE ae 
By Aa, — Ty oho 
To find the amplification factor, we take the absolute value of z//E, 
obtaining 


(10,110) 
E*, 


zi ay as 


E| 2 
Using the definition (19.108) of the quantities «, and a,, we find the 


following expression for the square of the amplification factor: 
wt 2 


k1s(o) = 2! = 


+ 1 2)° 
Ops — 7 eWyWolty 


&2(w, — w, — A) 


ki, (@,) = 


5 a, (w, — 1) a, (w,— wo, — 4) — Pewwrhs 
inal hed a 


4 D ; 
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D=[6,6,— yu, 0, ho- (w,— w,)(w,— oy, —A))V + [5, (re, --,—4) 


+ 6,(@,— w,)]*. (10.111) 
Similarly, we obtain 
A? 2 2 
kz, (a,) = re = rs 
: (10.112) 
1 wjpwszhg 


Gay? [ay (0, — 1) 2 (W, — wy — A) — emye02h5 I 


In the same way, we can calculate the amplification factor Jar the case 
where a harmonic voltage E,(t)= — E, sin (w,f+ Yo) is applicd to the 
second branch, by simply permuting the tndices | and 2 in (10.111) 
and (10.112): 


2 22,2 
k? ay _mioahe ta 
pe 64 |a, (w, — Wz — 4) &(W, — 2) — fpayerrhal?’ 
2 2 
2) a ,(w.—w,—A 
k22(w,) = s or * , 


4 [ay (w, — My — A) a, (w, = W>) = geo walti(? 

(10.113) 
The above results are valid even if the amplitudes and phases of the 
signals are not exactly constant, provided they do not chitnge much 
during times of order Ty, T3. 

6.2. Next we consider the case where the voltage £,(f) is a random 
process ¢(r) with spectral density S [é 3m], instead of a pure sinc wave. 
The fluctuating voltage €(r) may be applied to the circuit along with 
a sine wave, of it may arise because of thermal noise in the olumic 
resistance R,. A third possibility is that ¢(r) is due to fluctuations of 
the current flowing through the variable capacitance C(r), e-g., of the 
shot-noise type. The situation is the same in the second branch. All 
of these effects destroy the stability of the oscillatory regime, and lead 
to deviations from the stable values (10.110). [¢ follows from (10.103) 
that these fluctuations are described by the equations 


2,+6,2, — i he'“"2* = w,é' (2), 
(10.114) 


w as 
23 +5523 — Fi hte ‘42, =0, 
? 
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where ¢’(t)= — ie" E(t) is a zero-mean random function with 
correlation function 


PEP Se Cee 


and spectral density 


S[é’; wo] = 2 | ceeiryeleds =S[é;o+ a]. (10.115) 


Substituting the spectral expansions (cf. p. 1.28) 


2,()= [ets (w)dw, 


co 
J2n 

io, 5 (wm) daw 
21(0 = Fs |e 1(w)da, 


(i) = valedo des 


of the processes z,,2,,¢’ into (10.114), and equating spectral com- 
ponents of the same frequency in the resulting equations, we find that 
w 
(iw + 5,)2,(o) - “J? hel (4 — 0) = 0,E'(0), 


Patho) ds )etta — 0) — "2, (0) = 0. 


This system of equations has the solution 


” ; a3 (4 —w) PS 
21) = 0% | (ahal(4— a) — ayu,asna® 
eens 1 wash "(4 —a), 


4y af (A _ w) a, (w) — ga, waho 
analogous to (10.110), where 


a, (Q) = 6, + iQ, @(Q) = 6,4 iQ. 
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Therefore the corresponding spectral densities are 


53 + A- o 
S[z,;@] =o; » ua y 2S8[6 5], 
= (w) a 4 w) — tg, oh? |? 
teak 
S[z.; 0] = 22! S[c 2.4 aw]: 


a la* (A — «) a3 (w) — 5 Lew wah 


The spectral density S[x,;@] of the process x, = Re {=, e ’"} can be 
found by using formula (I.7.13). In fact, taking accouut of (10.115) as 
well, we can express S[.x, ;a] in terms of S[€;] and the amplification 
factor (10.111): 

S[x,; 0] = kj, (w)S[é; a]. (10.116) 
Similarly, we obtain 


S[x2: 0] = &3,(v—)S[E; v— @]. (10.117) 


The fluctuations caused by a random e.m.f. €(r)= £3 (1) in the second 
branch are investigated in the same way, and the corresponding spectral 
densities are given by the formulas 


S[x,;;@] =ki.(v— o) S[E; »-@], 
S[x2; o] = k32(w) S[E; w], 


analogous to (10.116) and (10.117). To obtain expressions for the 
spectral densities of the branch currents theinselves, we note that 
I, =C,x, (Say), and hence 


S[I,; 0] = 0° CjS[x,; o]. 


(10.118) 


6.3. Besides additive fluctuations appearing in E, and &,, we can 
also have parametric fluctuations, 1.e., a random component ¢ (f) in the 
function 

H(A) = hg Sin(vt + W) + €(1). 


As already noted, the oscillatory process is affected mainly by the 
spectral components of the fluctuations ¢(r) in the four regions near 
the frequencies 0, 2w,, |w, —w.| and w, +a. If the fluctuations are not 
too intense, these regions can be considered separately. We cun then 
add the spectral densities of the fluctuations contributed by the various 
regions and also by the voltages E, and E,. 
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Confining our attention to fluctuations ¢(f) in the frequency band 


jw —w,—,| <,,2, we can drop the terms C(1), [(4) e7 ties and 
C(rhe"2?-* in (10.103). This gives 
Zz, + O12, -— he'4'z : -_ = Ee'4"' 4 — '(n)2z3 ; 
mH) is (10.119) 
z 2 -ide ‘' 
la aeye h*ei4z, = 5 CO 2. 


where ('(t)=ie ““'*" €(1) is a zero-mean function with correlation 


function and spectral density 


COED = er OreE, 
S[¢'; a] =S[C; 04+ o,4+ @,]. 


The influence of the parametric fluctuations, described by the terms 
(C'z3> and (C'*z,> in (10.119), appears in two ways. In the first place, 
the fluctuations change the mean values (z,> and ¢z,> of the complex 
amplitudes, and secondly, they cause extra fluctuationa] scatter about 
these mean values. To study the first effect, we assume that the spectral 
density is approximately Constant in the narrow frequency band 


(10.120) 


lw — w, —w,|~ . 
Ti 2 


This allows us ¢o regard the correlation time 1,,, of the random process 
C(t) in (10.119) as much smalier than the relaxation time T,,, charac- 
terizing the time it takes the amplitudes to change appreciably : 


Teor < Ty; 2 : (10.121) 
Averaging the equations (10.119), we obtain 
: w 
(21) +5) ¢21) — hel (chy = ST Bes ST 2D, 


(10.122) 
(2D +8228) - o hve™!#¢2,) = ° (o'*2,). 
? 2y 


To calculate the averages (¢'z3) and (¢'*z,>, we use the method given 
on pp. 110-113, based on the condition (10.121). Let 4, be a time shift 
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such that t,,,<49<T,, 3. Then there is negligible dependence between 
C'(4) and z}(t— Ao), since t..,< Ay, and hence 


O(N 23 ()) = CC (N23 () — 23 (1— 40). (10.123) 


Moreover, during the time 4, the amplitudes do not inanage lo change 
appreciably. Therefore, integrating the second of the equations 
(10.119), we obtain 


w) 
23 (t) — 23 (1 — Ag) B — 6323 (1 — 4g) Ag + i he '"2, (4 — Ag) Ag 
f 


w 
+5" 21(t— Ao) | o™(a)da. (10.124) 
? 


t—dAa 
Substitution of (10.124) into (10.123) gives 
0 
- w as ra) 
CG z> =~ (21) | C§ CF) dr =" (2,>t. 
2y 4y 
where 


ys Q 
ee 2 | CO dt = 2 | ce) eller tor de 


19] 
=4S[C; , + w,] + 21 | CCC,» sin[(w, + @2)t] dt. 
In the same way, we find that 
“ w;? 
C= DK 


As a result, the equations (10.122) take the forin 


M5 


8 


(4) + (4: 7 «) (21) = hel*(28) = 3 Eel4t. 


ew , (10.125) 
(23> + (3 = a «| (23) — qe Men =0. 
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These equations differ from (10.106) only by having 


x w),W) x ),W2 
6,=06,-—-- °K, 0,=6, —- — 
1 1 8 2 = 8 
instead of 6, and 6,. Taking account of the real part of these cor- 
rections, we conclude that the presence of parametric fluctuations 
decreases the damping in each branch by an amount 


* 
K 


wo : 
Tg SEO + w,]. 
The solution of ¢he system (10,125) is the saine as that of (10.106), 
provided we replace «,(Q) and «,(Q) in formulas (10.107) and 
(10.110)-(10.113) by 


4, (0) = 6; —— 


— K+ iQ, 

(10.126) 
~ WW. * r 
@,(Q) = 6, -— reat + iQ. 


Then the stationary mean amplitudes corresponding to (10.110) 
become 


(2h) = (z,ye7ait = wD, &(— 4:) 


2 & (4,)&(— 42) — 16010; Itg 


(22) = (2,pe7it ao apse pala ,E 
8y &, (— 4,)&2 (42) — q'gm102G 


(10.127) 


* 


The new values of amplification factors (10.111)-(10.113), with a,, «, 
replaced by &,, @,, will be denoted by k,,, £3,, ky, k,,. 

We now turn to the second effect, i.e., the extra scatter about the 
mean values (z,> and (z3> due to the parametric fluctuations ((f). 
Introducing the deviations 


Oz, =2Z,—(2Z,), 022; =22— (22), (10.128) 
we deduce from (10.119) and (10.125) that 
52, + 3,82, — ae h el 62% = = (8d 0, 
woh" 3 (10.129) 
625 +4,6z, — 2 ei4tg7) = : 50", 
4y 2y 


SEC. 6] PARAMETRIC OSCILLATIONS 319 


if the Auctuations are small. These equations resenible (10.114), bute 
the attenuations are different and both cquations contain Muctuational 
terms. The correspondence between (10.129) and (10.114) becomes more 
complete if we introduce the random processes 


Eu) = Eaten TE caity Geter, 


1 ; (10. 130) 
ea (1) penne (2450 eit at! (2i*) te whence 
2y 2y 
with spectral densities 
7 
S[¢,;0]= 4 I(za>|* S[C; o+0v—,]. 
(10.131) 


l 
Sia] =), KKzy>/?S[l; a+ o,). 


The stationary mean amplitudes ¢z,> and (23> appearing in (0.131) 
correspond to the stationary regime are given by (10.127). Moreover, 
the random processes €,(#) and €,(t) can be regarded as uncorre- 
lated, since their cross-correlation function is proportional to the 
expression 

(tl) e7 iv aay tise 


which vanishes when averaged with respect fo ¢t. It follows from 
(10.131) and (10.116)-(10.118) that . 


2 
S[x1; 0] = ki, () 7 (zp /S[so+v—,] 
1 
+ kiz(v ~a) dy Kz)? S[ivto,-o], 
2 


S [x23 0] = k3,(¥ — 0) (f K2a)PS[E: 2° - 0. — 0 


1 
+ ki, (o) dy? |<z, 17S [(;@+,]. 
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or 
2p2 


Sluis] =" yo) ki (o)S[io+ v— a] 


E? 
+? ki, (@,)ki2(v-—@) SE; v +a, -o], 
VE? 
S[x2; a] = “4 ; k3, (ws) k3, (v~—w)S[C;2v—a@, — aw] 


2 

er 
in terms of the various amplification factors [cf. (10.110}-(10.113)]. 
According to these formulas, the effect of the parametric fluctuations 
{(£) on the processes x, and x, is proportional to the square of the 
amplitude E of the signal being amplified. 

The first of the equations (10.132) shows that the spectral density 
of the process x, near the frequency @, is proportional to the spectral 
density of the parametric fluctuations near the frequency v. If the 
spectral density S[¢;w] is approximately constant for both |w—»|~6,, 
6, and |w—v|~4,, 4, then the spectral densities on the right in 
(10.132) can all be replaced by S[€;v]. Integrating the first of the 
equations (10.132) and taking account of (1.2.15), we find that the 
variance of the amplified signal is given by 


ki, (@,) k3, (w)S[C; o +. @,] (10.132) 


a? (x, J 2,2 | 
mS = 5 S[¢; v] f ki, (o,) | kr (a) dw 


1 @ 
+H) j Kis(a) do} 


Therefore the parametric fluctuations give a constant signal-to-noise 
ratio, regardless of the strength of the signal: 


ki (aye 


a(x) 


Lo] 


: 2 Wy -t2 
= 2/2n4 {s [és v] ([ H.(o)d + ee | kii (w)du 
0 a 
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The presence of the neglected terms in the right-hind side of (10.103) 
causes other frequency regions in the spectral density S[¢;«] to affect 
the fluctuational scatter of the processes x, and x,. For example, the 
term Hz,e°2"®™ leads to the appearance of Auctuational com- 
Ponents with intensity proportional to S[€.w,—«,]. which satisfy 
formulas analogous to those derived above. 
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Stratonovich and Y. I. Tikhonov has appeared in E1iglish (ranslation. 
The papers cited on pp. 1.47, 1.62, I.143, I.149 and 1.205 (his) all 
appear in this collection, on pp. 59, 77, 405, 101, 3and 29, respectively. 
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